Sep 30 17:45:42 devstack cinder-volume[76413]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 30 17:45:42 devstack cinder-volume[76413]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 30 17:45:42 devstack cinder-volume[76413]: we strongly recommend against using it for new projects.
Sep 30 17:45:42 devstack cinder-volume[76413]: If you are already using Eventlet, we recommend migrating to a different
Sep 30 17:45:42 devstack cinder-volume[76413]: framework.  For more detail see
Sep 30 17:45:42 devstack cinder-volume[76413]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 30 17:45:42 devstack cinder-volume[76413]:   import eventlet  # noqa
Sep 30 17:45:45 devstack cinder-volume[76413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:45:45 devstack cinder-volume[76413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:45:45 devstack cinder-volume[76413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:45:46 devstack cinder-volume[76413]: INFO dbcounter [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Registered counter for database cinder
Sep 30 17:45:46 devstack cinder-volume[76413]: DEBUG oslo_db.sqlalchemy.engines [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:45:46 devstack cinder-volume[76413]: DEBUG dbcounter [-] [76413] Writer thread running {{(pid=76413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 30 17:45:46 devstack cinder-volume[76413]: INFO cinder.rpc [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 17:45:46 devstack cinder-volume[76413]: INFO cinder.rpc [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 17:45:46 devstack cinder-volume[76413]: DEBUG oslo_db.sqlalchemy.engines [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:45:46 devstack cinder-volume[76413]: INFO cinder.volume.manager [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Determined volume DB was empty at startup.
Sep 30 17:45:46 devstack cinder-volume[76413]: DEBUG cinder.volume.manager [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76413) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 30 17:45:46 devstack cinder-volume[76413]: INFO cinder.volume.manager [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 30 17:45:46 devstack cinder-volume[76413]: WARNING stevedore.named [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 17:45:46 devstack cinder-volume[76413]: WARNING castellan.key_manager [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:45:46 devstack cinder-volume[76413]: WARNING cinder.keymgr.conf_key_mgr [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:45:46 devstack cinder-volume[76413]: DEBUG cinder.volume.drivers.lvm [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76413) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 30 17:45:46 devstack cinder-volume[76413]: DEBUG oslo_concurrency.processutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_concurrency.processutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] CMD "cinder-rtstool verify" returned: 0 in 0.445s {{(pid=76413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_db.sqlalchemy.engines [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:45:47 devstack cinder-volume[76413]: INFO cinder.rpc [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 30 17:45:47 devstack cinder-volume[76413]: INFO cinder.rpc [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 30 17:45:47 devstack cinder-volume[76413]: WARNING stevedore.named [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 17:45:47 devstack cinder-volume[76413]: WARNING castellan.key_manager [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:45:47 devstack cinder-volume[76413]: INFO cinder.volume.manager [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_db.sqlalchemy.engines [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:45:47 devstack cinder-volume[76413]: INFO oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Starting 1 workers
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Started child 76573 {{(pid=76413) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Full set of CONF: {{(pid=76413) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 30 17:45:47 devstack cinder-volume[76573]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] ******************************************************************************** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Configuration options gathered from: {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] ================================================================================ {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] allow_availability_zone_fallback = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] allow_compression_on_image_upload = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] allowed_direct_url_schemes     = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] api_rate_limit                 = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] auth_strategy                  = keystone {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] az_cache_duration              = 3600 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_availability_zone      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_host                   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_name                   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_stats_polling_interval = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backup_api_class               = cinder.backup.api.API {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backup_name_template           = backup-%s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backup_use_same_host           = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backup_use_temp_snapshot       = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] chap_password                  = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] chap_username                  =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_internal_tenant_project_id = a87db87456794ab0850ada3dcfb73e55 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_internal_tenant_user_id = 4983fc29886b4cfe82febc7c244bbe74 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cloned_volume_same_az          = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cluster                        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] compression_format             = gzip {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] config_dir                     = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] config_source                  = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] control_exchange               = openstack {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] debug                          = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] default_availability_zone      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] default_group_type             = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] default_volume_type            = lvmdriver-1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] disk_geometry                  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] driver_client_cert             = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] driver_client_cert_key         = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] driver_data_namespace          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] driver_ssl_cert_path           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] driver_ssl_cert_verify         = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] driver_use_ssl                 = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] enable_force_upload            = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] enable_new_services            = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] enable_unsupported_driver      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] enforce_multipath_for_image_xfer = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] filter_function                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_api_insecure            = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_api_servers             = ['http://192.168.122.25/image'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_api_ssl_compression     = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_ca_certificates_file    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_certfile                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_keyfile                 = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_num_retries             = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance_request_timeout         = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] goodness_function              = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] graceful_shutdown_timeout      = 5 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] group_api_class                = cinder.group.api.API {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] host                           = devstack {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_compress_on_upload       = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_conversion_address_space_limit = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_conversion_cpu_limit     = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_conversion_disable       = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_introspection_address_space_limit = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_introspection_cpu_limit  = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_upload_use_cinder_backend = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_upload_use_internal_tenant = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_volume_cache_enabled     = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_volume_cache_max_count   = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] image_volume_cache_max_size_gb = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] init_host_max_objects_retrieval = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] iscsi_target_flags             =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] iscsi_write_cache              = on {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] iser_helper                    = tgtadm {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] iser_ip_address                = 192.168.122.25 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] iser_port                      = 3260 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_color                      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_config_append              = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_dir                        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_file                       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_options                    = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_rotate_interval            = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_rotate_interval_type       = days {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] log_rotation_type              = none {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] max_age                        = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76573]: INFO cinder.volume.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] max_logfile_count              = 30 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] max_logfile_size_mb            = 200 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] max_over_subscription_ratio    = 20.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] message_reap_interval          = 86400 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] message_ttl                    = 2592000 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] migration_create_volume_timeout_secs = 300 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] monkey_patch                   = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] monkey_patch_modules           = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] my_ip                          = 192.168.122.25 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] no_snapshot_gb_quota           = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] num_iser_scan_tries            = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] num_shell_tries                = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] num_volume_device_scan_tries   = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] nvmeof_conn_info_version       = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] nvmet_ns_id                    = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] nvmet_port_id                  = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_max_limit                = 1000 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_volume_ext_list          = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_volume_listen_port       = 8776 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_volume_use_ssl           = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] osapi_volume_workers           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] per_volume_size_limit          = -1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] periodic_fuzzy_delay           = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] periodic_interval              = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] public_endpoint                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] publish_errors                 = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_backup_gigabytes         = 1000 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_backups                  = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_gigabytes                = 1000 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_groups                   = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_snapshots                = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] quota_volumes                  = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] rate_limit_burst               = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] rate_limit_except_level        = CRITICAL {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] rate_limit_interval            = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] reinit_driver_count            = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] replication_device             = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] report_discard_supported       = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] report_interval                = 120 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] reservation_clean_interval     = 86400 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] reservation_expire             = 86400 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] reserved_image_namespaces      = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] reserved_percentage            = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] rpc_response_timeout           = 120 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] run_external_periodic_tasks    = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] scst_target_driver             = iscsi {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] scst_target_iqn_name           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_down_time              = 720 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] shell_completion               = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] snapshot_name_template         = snapshot-%s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] snapshot_same_host             = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] split_loggers                  = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] state_path                     = /opt/stack/data/cinder {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] storage_availability_zone      = nova {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] storage_protocol               = iSCSI {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] syslog_log_facility            = LOG_USER {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] target_helper                  = lioadm {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] target_ip_address              = 192.168.122.25 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] target_port                    = 3260 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] target_protocol                = iscsi {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] target_secondary_ip_addresses  = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] trace_flags                    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] transport_url                  = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] until_refresh                  = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_chap_auth                  = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_default_quota_class        = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_journal                    = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_json                       = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_multipath_for_image_xfer   = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_stderr                     = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] use_syslog                     = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] verify_glance_signatures       = enabled {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_api_class               = cinder.volume.api.API {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_backend_name            = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_clear                   = zero {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_clear_ionice            = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_clear_size              = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_copy_bps_limit          = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_dd_blocksize            = 1M {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_name_template           = volume-%s {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_service_inithost_offload = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volume_usage_audit_period      = month {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] zoning_mode                    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_concurrency.disable_process_locking = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.auth_section = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.auth_type   = password {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.auth_version = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.cache       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.certfile    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.include_service_catalog = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.insecure    = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.interface   = public {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.keyfile     = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_password = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcache_username = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.region_name = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.service_type = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.backend                  = dogpile.cache.null {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.backend_argument         = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.backend_expiration_time  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.config_prefix            = cache.oslo {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.debug_cache_backend      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.enable_retry_client      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.enable_socket_keepalive  = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.enabled                  = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.expiration_time          = 600 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.hashclient_retry_attempts = 2 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_dead_retry      = 300 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_sasl_enabled    = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.password                 = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.proxies                  = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.redis_db                 = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.redis_server             = localhost:6379 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.retry_attempts           = 2 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.retry_delay              = 0.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.socket_keepalive_count   = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.socket_keepalive_idle    = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.socket_keepalive_interval = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.socket_timeout           = 1.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.tls_allowed_ciphers      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.tls_cafile               = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.tls_certfile             = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.tls_enabled              = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.tls_keyfile              = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cache.username                 = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] coordination.backend_url       = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.asyncio_connection    = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.asyncio_slave_connection = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.backend               = sqlalchemy {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.connection            = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.connection_debug      = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.connection_parameters =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.connection_recycle_time = 3600 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.connection_trace      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.db_inc_retry_interval = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.db_max_retries        = 20 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.db_max_retry_interval = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.db_retry_interval     = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.max_overflow          = 50 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.max_pool_size         = 5 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.max_retries           = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.mysql_wsrep_sync_wait = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.pool_timeout          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.retry_interval        = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.slave_connection      = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.sqlite_synchronous    = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.synchronous_reader    = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] database.use_db_reconnect      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_tracing.insecure = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.connection_string     = messaging:// {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.enabled               = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.es_doc_type           = notification {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.es_scroll_size        = 10000 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.es_scroll_time        = 2m {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.filter_error_trace    = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.hmac_keys             = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.sentinel_service_name = mymaster {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.socket_timeout        = 0.1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.trace_requests        = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler.trace_sqlalchemy      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler_jaeger.process_tags   = {} {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler_jaeger.service_name_prefix = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] profiler_otlp.service_name_prefix = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.enforce_new_defaults = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.policy_default_rule = default {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.group          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.helper_command = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] privsep_osbrick.user           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.group         = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.helper_command = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] cinder_sys_admin.user          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.auth_section      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.auth_type         = password {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.cafile            = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.certfile          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.collect_timing    = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.insecure          = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.keyfile           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.send_service_user_token = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.split_loggers     = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.timeout           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.tls_ciphers       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] service_user.tls_min_version   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.auth_section            = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.auth_type               = password {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.certfile                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.collect_timing          = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.insecure                = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.keyfile                 = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.region_name             = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.split_loggers           = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.timeout                 = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.tls_ciphers             = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] glance.tls_min_version         = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.backend_availability_zone = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.chap_password = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.chap_username =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.disk_geometry = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.driver_client_cert = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.driver_client_cert_key = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.driver_data_namespace = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.driver_use_ssl = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.extra_capabilities = {} {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.filter_function = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.goodness_function = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.iscsi_target_flags =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.iscsi_write_cache = on {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.iser_port     = 3260 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack sudo[76577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.lvm_share_target = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.lvm_type      = auto {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack sudo[76577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.num_shell_tries = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.replication_device = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.report_discard_supported = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.reserved_percentage = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.target_helper = tgtadm {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.target_port   = 3260 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.target_protocol = iscsi {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.trace_flags   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.unique_fqdn_network = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.use_chap_auth = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_backend_name = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_clear  = zero {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_clear_ionice = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_clear_size = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_reports.file_event_handler = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_reports.log_dir           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.backend_host       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.chap_password      = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.chap_username      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.disk_geometry      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.driver_client_cert = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.extra_capabilities = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.filter_function    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.goodness_function  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.iser_helper        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.iser_port          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.lvm_type           = auto {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.replication_device = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.report_discard_supported = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.reserved_percentage = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.scst_target_driver = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.storage_protocol   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.target_ip_address  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.target_port        = 3260 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.trace_flags        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_clear       = zero {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] lvmdriver-1.volumes_dir        = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_notifications.driver = [] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_notifications.retry = -1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] key_manager.fixed_key          = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.barbican_api_version  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.barbican_endpoint     = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.barbican_endpoint_type = public {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.barbican_region_name  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.cafile                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.certfile              = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.collect_timing        = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.insecure              = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.keyfile               = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.number_of_retries     = 60 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.retry_delay           = 1 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.send_service_user_token = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.split_loggers         = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.timeout               = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.tls_ciphers           = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.tls_min_version       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.verify_ssl            = True {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican.verify_ssl_path       = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.auth_section = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.auth_type = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.cafile   = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.certfile = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.collect_timing = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.insecure = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.keyfile  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.split_loggers = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.timeout  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.tls_ciphers = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] barbican_service_user.tls_min_version = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.approle_role_id          = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.approle_secret_id        = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.auth_method              = approle {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.auth_path                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.kv_mountpoint            = secret {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.kv_path                  = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.kv_version               = 2 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.namespace                = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.root_token_id            = **** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.ssl_ca_crt_file          = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.timeout                  = 60.0 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.token_file               = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.token_role               = None {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.use_ssl                  = False {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:45:47 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] ******************************************************************************** {{(pid=76413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 30 17:45:47 devstack sudo[76577]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:48 devstack sudo[76581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:48 devstack sudo[76581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:48 devstack sudo[76581]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.268s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 17:45:48 devstack cinder-volume[76573]: INFO cinder.brick.local_dev.lvm [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:48 devstack sudo[76588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:45:48 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:48 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG cinder.brick.local_dev.lvm [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76573) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 30 17:45:48 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:48 devstack sudo[76682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:48 devstack sudo[76682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:49 devstack sudo[76682]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:49 devstack sudo[76896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:49 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:49 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:49 devstack sudo[76989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 30 17:45:49 devstack sudo[76989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:49 devstack sudo[76989]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.246s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:49 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:49 devstack sudo[77075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:45:49 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:50 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:50 devstack sudo[77196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:45:50 devstack sudo[77196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:50 devstack sudo[77196]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:50 devstack sudo[77199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:50 devstack sudo[77199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:50 devstack sudo[77199]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:50 devstack sudo[77283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:50 devstack sudo[77283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:50 devstack sudo[77283]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:50 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:50 devstack sudo[77287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:50 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:51 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:51 devstack cinder-volume[76573]: INFO cinder.volume.drivers.lvm [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:51 devstack sudo[77343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:51 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:51 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:51 devstack sudo[77380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:45:51 devstack sudo[77380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:51 devstack sudo[77380]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:51 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:51 devstack sudo[77389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:51 devstack sudo[77389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:52 devstack sudo[77389]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:52 devstack sudo[77392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:52 devstack sudo[77392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:52 devstack sudo[77392]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:52 devstack sudo[77395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:52 devstack sudo[77395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:52 devstack sudo[77395]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:52 devstack cinder-volume[76573]: INFO cinder.volume.driver [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG cinder.volume.driver [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76573) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_db.sqlalchemy.engines [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writer thread running {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG cinder.db.api [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Building query based on filter {{(pid=76573) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG cinder.image.image_utils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76573) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 30 17:45:52 devstack cinder-volume[76573]: INFO cinder.keymgr.migration [None req-4adc47e3-fd40-4952-9131-a2aec6ff9efc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:45:52 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:52 devstack sudo[77399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:45:52 devstack sudo[77399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:53 devstack sudo[77399]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:53 devstack sudo[77402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:53 devstack sudo[77402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:53 devstack sudo[77402]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:53 devstack sudo[77405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:53 devstack sudo[77405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:53 devstack sudo[77405]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:53 devstack sudo[77410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:53 devstack sudo[77410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:53 devstack sudo[77410]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG cinder.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Notifying Schedulers of capabilities ... {{(pid=76573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:45:53 devstack cinder-volume[76573]: INFO cinder.volume.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Driver initialization completed successfully.
Sep 30 17:45:53 devstack cinder-volume[76573]: INFO cinder.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Initiating service 2 cleanup
Sep 30 17:45:53 devstack cinder-volume[76573]: INFO cinder.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Service 2 cleanup completed.
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG cinder.service [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Creating RPC server for service cinder-volume {{(pid=76573) start /opt/stack/cinder/cinder/service.py:231}}
Sep 30 17:45:53 devstack cinder-volume[76573]: DEBUG cinder.service [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76573) start /opt/stack/cinder/cinder/service.py:237}}
Sep 30 17:45:54 devstack cinder-volume[76573]: INFO cinder.volume.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:54 devstack sudo[77413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:45:54 devstack sudo[77413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:54 devstack sudo[77413]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:54 devstack sudo[77417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:54 devstack sudo[77417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:54 devstack sudo[77417]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:54 devstack sudo[77420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:45:54 devstack sudo[77420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:54 devstack sudo[77420]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:54 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:45:54 devstack sudo[77426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:45:54 devstack sudo[77426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:45:55 devstack sudo[77426]: pam_unix(sudo:session): session closed for user root
Sep 30 17:45:55 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:45:55 devstack cinder-volume[76573]: INFO cinder.volume.manager [None req-3475db36-303f-4531-84cc-377463ed7e94 None None] Driver post RPC initialization completed successfully.
Sep 30 17:45:57 devstack cinder-volume[76413]: DEBUG dbcounter [-] [76413] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:45:59 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:45:59 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread count: 6 {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:45:59 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread info: [<_MainThread(MainThread, started 135780922699904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135780807186176)>, <Thread(Thread-3 (stat_writer), started daemon 135780807542656)>, <Thread(Rabbit-heartbeat, started daemon 135780806809536)>, <Thread(Thread-5 (_runner), started daemon 135780806859648)>, <Thread(Thread-7 (_runner), started daemon 135780806989312)>] {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:46:05 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writing DB stats cinder:SELECT=4 {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:46:05 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:46:59 devstack sudo[79485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:46:59 devstack sudo[79485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:46:59 devstack sudo[79485]: pam_unix(sudo:session): session closed for user root
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:46:59 devstack sudo[79488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:46:59 devstack sudo[79488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:46:59 devstack sudo[79488]: pam_unix(sudo:session): session closed for user root
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:46:59 devstack sudo[79491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:46:59 devstack sudo[79491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:46:59 devstack sudo[79491]: pam_unix(sudo:session): session closed for user root
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:46:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:46:59 devstack sudo[79554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:46:59 devstack sudo[79554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:47:00 devstack sudo[79554]: pam_unix(sudo:session): session closed for user root
Sep 30 17:47:00 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:47:00 devstack cinder-volume[76573]: DEBUG cinder.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Notifying Schedulers of capabilities ... {{(pid=76573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:47:00 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:47:00 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread count: 6 {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:47:00 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread info: [<_MainThread(MainThread, started 135780922699904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135780807186176)>, <Thread(Thread-3 (stat_writer), started daemon 135780807542656)>, <Thread(Rabbit-heartbeat, started daemon 135780806809536)>, <Thread(Thread-5 (_runner), started daemon 135780806859648)>, <Thread(Thread-7 (_runner), started daemon 135780806989312)>] {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:47:59 devstack sudo[82777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:47:59 devstack sudo[82777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:47:59 devstack sudo[82777]: pam_unix(sudo:session): session closed for user root
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:47:59 devstack sudo[82814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:47:59 devstack sudo[82814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:47:59 devstack sudo[82814]: pam_unix(sudo:session): session closed for user root
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:47:59 devstack sudo[82819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:47:59 devstack sudo[82819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:47:59 devstack sudo[82819]: pam_unix(sudo:session): session closed for user root
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:47:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:47:59 devstack sudo[82860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:47:59 devstack sudo[82860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:48:00 devstack sudo[82860]: pam_unix(sudo:session): session closed for user root
Sep 30 17:48:00 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:48:00 devstack cinder-volume[76573]: DEBUG cinder.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Notifying Schedulers of capabilities ... {{(pid=76573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:48:05 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writing DB stats cinder:SELECT=1 {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:48:05 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writing DB stats cinder:UPDATE=1 {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:48:59 devstack sudo[84862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:48:59 devstack sudo[84862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:48:59 devstack sudo[84862]: pam_unix(sudo:session): session closed for user root
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:48:59 devstack sudo[84866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:48:59 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:48:59 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:48:59 devstack sudo[84870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:48:59 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:48:59 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:48:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:48:59 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:48:59 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:49:00 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Sep 30 17:49:00 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:49:00 devstack cinder-volume[76573]: DEBUG cinder.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Notifying Schedulers of capabilities ... {{(pid=76573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:49:00 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:49:00 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread count: 6 {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:49:00 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread info: [<_MainThread(MainThread, started 135780922699904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135780807186176)>, <Thread(Thread-3 (stat_writer), started daemon 135780807542656)>, <Thread(Rabbit-heartbeat, started daemon 135780806809536)>, <Thread(Thread-5 (_runner), started daemon 135780806859648)>, <Thread(Thread-7 (_runner), started daemon 135780806989312)>] {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG cinder.volume.drivers.lvm [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Updating volume stats {{(pid=76573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:49:59 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 17:49:59 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:49:59 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:49:59 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:49:59 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:49:59 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:49:59 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 17:49:59 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:49:59 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:49:59 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:49:59 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 17:49:59 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:00 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:00 devstack cinder-volume[76573]: DEBUG oslo_concurrency.processutils [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:00 devstack cinder-volume[76573]: DEBUG cinder.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Notifying Schedulers of capabilities ... {{(pid=76573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:50:00 devstack cinder-volume[76573]: DEBUG oslo_service.periodic_task [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76573) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:50:00 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread count: 6 {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:50:00 devstack cinder-volume[76573]: DEBUG cinder.volume.manager [None req-067fd413-8920-4c90-beb7-5fa6ecb283a1 None None] thread info: [<_MainThread(MainThread, started 135780922699904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135780807186176)>, <Thread(Thread-3 (stat_writer), started daemon 135780807542656)>, <Thread(Rabbit-heartbeat, started daemon 135780806809536)>, <Thread(Thread-5 (_runner), started daemon 135780806859648)>, <Thread(Thread-7 (_runner), started daemon 135780806989312)>] {{(pid=76573) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:50:05 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writing DB stats cinder:SELECT=1 {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:50:05 devstack cinder-volume[76573]: DEBUG dbcounter [-] [76573] Writing DB stats cinder:UPDATE=1 {{(pid=76573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:50:15 devstack cinder-volume[76413]: INFO oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Caught SIGTERM, stopping children
Sep 30 17:50:15 devstack cinder-volume[76413]: DEBUG oslo_concurrency.lockutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Acquiring lock "singleton_lock" {{(pid=76413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:50:15 devstack cinder-volume[76413]: DEBUG oslo_concurrency.lockutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Acquired lock "singleton_lock" {{(pid=76413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:50:15 devstack cinder-volume[76413]: DEBUG oslo_concurrency.lockutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Releasing lock "singleton_lock" {{(pid=76413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:50:15 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Stop services. {{(pid=76413) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 30 17:50:15 devstack cinder-volume[76413]: DEBUG oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Killing children. {{(pid=76413) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 30 17:50:15 devstack cinder-volume[76413]: INFO oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Waiting on 1 children to exit
Sep 30 17:50:19 devstack cinder-volume[76573]: DEBUG oslo_concurrency.lockutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Acquiring lock "singleton_lock" {{(pid=76573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:50:19 devstack cinder-volume[76573]: DEBUG oslo_concurrency.lockutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Acquired lock "singleton_lock" {{(pid=76573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:50:19 devstack cinder-volume[76573]: DEBUG oslo_concurrency.lockutils [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Releasing lock "singleton_lock" {{(pid=76573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:50:19 devstack cinder-volume[76573]: WARNING amqp [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 17:50:19 devstack cinder-volume[76573]: WARNING amqp [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 17:50:19 devstack cinder-volume[76413]: INFO oslo_service.backend._eventlet.service [None req-0fee34a8-bd9d-4235-b82c-6891cd75dd51 None None] Child 76573 exited with status 0
Sep 30 17:50:19 devstack cinder-volume[86542]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 30 17:50:19 devstack cinder-volume[86542]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 30 17:50:19 devstack cinder-volume[86542]: we strongly recommend against using it for new projects.
Sep 30 17:50:19 devstack cinder-volume[86542]: If you are already using Eventlet, we recommend migrating to a different
Sep 30 17:50:19 devstack cinder-volume[86542]: framework.  For more detail see
Sep 30 17:50:19 devstack cinder-volume[86542]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 30 17:50:19 devstack cinder-volume[86542]:   import eventlet  # noqa
Sep 30 17:50:21 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:50:21 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:50:21 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO dbcounter [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Registered counter for database cinder
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG dbcounter [-] [86542] Writer thread running {{(pid=86542) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO cinder.rpc [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO cinder.rpc [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO cinder.volume.manager [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Determined volume DB was empty at startup.
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG cinder.volume.manager [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86542) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO cinder.volume.manager [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 30 17:50:22 devstack cinder-volume[86542]: WARNING stevedore.named [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 17:50:22 devstack cinder-volume[86542]: WARNING castellan.key_manager [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:50:22 devstack cinder-volume[86542]: WARNING cinder.keymgr.conf_key_mgr [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO cinder.volume.manager [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:22 devstack cinder-volume[86542]: INFO oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Starting 1 workers
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Started child 86764 {{(pid=86542) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Full set of CONF: {{(pid=86542) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] ******************************************************************************** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Configuration options gathered from: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] ================================================================================ {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] allow_availability_zone_fallback = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] allow_compression_on_image_upload = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] allowed_direct_url_schemes     = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] api_rate_limit                 = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] auth_strategy                  = keystone {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_availability_zone      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_host                   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_name                   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_stats_polling_interval = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backup_api_class               = cinder.backup.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backup_name_template           = backup-%s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backup_use_same_host           = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backup_use_temp_snapshot       = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] chap_password                  = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] chap_username                  =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_internal_tenant_project_id = a87db87456794ab0850ada3dcfb73e55 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_internal_tenant_user_id = 4983fc29886b4cfe82febc7c244bbe74 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cluster                        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] compression_format             = gzip {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] config_dir                     = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] config_source                  = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] control_exchange               = openstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86764]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] debug                          = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] default_availability_zone      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] default_group_type             = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] default_volume_type            = QuobyteHD {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] disk_geometry                  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] driver_client_cert             = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] driver_client_cert_key         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] driver_data_namespace          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] driver_ssl_cert_path           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] driver_ssl_cert_verify         = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] driver_use_ssl                 = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] enable_new_services            = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] enable_unsupported_driver      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] enforce_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] filter_function                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:22 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_api_insecure            = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_api_servers             = ['http://192.168.122.25/image'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_api_ssl_compression     = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_ca_certificates_file    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_certfile                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_keyfile                 = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_num_retries             = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance_request_timeout         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] goodness_function              = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] graceful_shutdown_timeout      = 5 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] group_api_class                = cinder.group.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] host                           = devstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_compress_on_upload       = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_conversion_address_space_limit = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_conversion_cpu_limit     = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_conversion_disable       = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_introspection_address_space_limit = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_introspection_cpu_limit  = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_upload_use_cinder_backend = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_upload_use_internal_tenant = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_volume_cache_enabled     = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_volume_cache_max_count   = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] init_host_max_objects_retrieval = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] iscsi_target_flags             =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] iscsi_write_cache              = on {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] iser_helper                    = tgtadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] iser_ip_address                = 192.168.122.25 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] iser_port                      = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_color                      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_config_append              = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_dir                        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_file                       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_options                    = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_rotate_interval            = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_rotate_interval_type       = days {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] log_rotation_type              = none {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] max_age                        = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] max_logfile_count              = 30 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] max_logfile_size_mb            = 200 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] max_over_subscription_ratio    = 20.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] message_reap_interval          = 86400 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] message_ttl                    = 2592000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] monkey_patch                   = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] monkey_patch_modules           = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] my_ip                          = 192.168.122.25 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] no_snapshot_gb_quota           = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] num_iser_scan_tries            = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] num_shell_tries                = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] num_volume_device_scan_tries   = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] nvmeof_conn_info_version       = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] nvmet_ns_id                    = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] nvmet_port_id                  = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_max_limit                = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_volume_ext_list          = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_volume_listen_port       = 8776 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_volume_use_ssl           = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] osapi_volume_workers           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] per_volume_size_limit          = -1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] periodic_fuzzy_delay           = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] periodic_interval              = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] public_endpoint                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] publish_errors                 = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_backup_gigabytes         = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_backups                  = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_gigabytes                = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_groups                   = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_snapshots                = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] quota_volumes                  = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] rate_limit_burst               = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] rate_limit_except_level        = CRITICAL {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] rate_limit_interval            = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] reinit_driver_count            = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] replication_device             = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] report_discard_supported       = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] report_interval                = 120 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] reservation_clean_interval     = 86400 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] reservation_expire             = 86400 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] reserved_image_namespaces      = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] reserved_percentage            = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] rpc_response_timeout           = 120 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] run_external_periodic_tasks    = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] scst_target_driver             = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] scst_target_iqn_name           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_down_time              = 720 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] shell_completion               = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] snapshot_name_template         = snapshot-%s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] split_loggers                  = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] state_path                     = /opt/stack/data/cinder {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] storage_availability_zone      = nova {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] storage_protocol               = iSCSI {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] syslog_log_facility            = LOG_USER {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] target_helper                  = lioadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] target_ip_address              = 192.168.122.25 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] target_port                    = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] target_protocol                = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] target_secondary_ip_addresses  = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] trace_flags                    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] transport_url                  = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] until_refresh                  = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_chap_auth                  = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_default_quota_class        = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_journal                    = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_json                       = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_multipath_for_image_xfer   = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_stderr                     = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] use_syslog                     = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] verify_glance_signatures       = enabled {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_api_class               = cinder.volume.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_backend_name            = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_clear                   = zero {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_clear_ionice            = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_clear_size              = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_copy_bps_limit          = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_dd_blocksize            = 1M {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_name_template           = volume-%s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_service_inithost_offload = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volume_usage_audit_period      = month {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] zoning_mode                    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.auth_section = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.auth_type   = password {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.auth_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.cache       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.certfile    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.insecure    = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.interface   = public {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.keyfile     = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcache_username = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.region_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.service_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.backend                  = dogpile.cache.null {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.backend_argument         = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.backend_expiration_time  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.config_prefix            = cache.oslo {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.debug_cache_backend      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.enable_retry_client      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.enable_socket_keepalive  = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.enabled                  = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.expiration_time          = 600 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_dead_retry      = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_sasl_enabled    = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.password                 = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.proxies                  = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.redis_db                 = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.redis_server             = localhost:6379 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.retry_attempts           = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.retry_delay              = 0.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.socket_keepalive_count   = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.socket_keepalive_idle    = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.socket_keepalive_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.socket_timeout           = 1.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.tls_allowed_ciphers      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.tls_cafile               = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.tls_certfile             = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.tls_enabled              = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.tls_keyfile              = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cache.username                 = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] coordination.backend_url       = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.asyncio_connection    = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.asyncio_slave_connection = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.backend               = sqlalchemy {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.connection            = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.connection_debug      = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.connection_parameters =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.connection_recycle_time = 3600 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.connection_trace      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.db_inc_retry_interval = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.db_max_retries        = 20 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.db_max_retry_interval = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.db_retry_interval     = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.max_overflow          = 50 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.max_pool_size         = 5 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.max_retries           = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.pool_timeout          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.retry_interval        = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.slave_connection      = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.sqlite_synchronous    = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86764]: INFO cinder.volume.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.synchronous_reader    = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] database.use_db_reconnect      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_tracing.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.connection_string     = messaging:// {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.enabled               = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.es_doc_type           = notification {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.es_scroll_size        = 10000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.es_scroll_time        = 2m {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.remotefs [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86764) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.filter_error_trace    = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.hmac_keys             = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.sentinel_service_name = mymaster {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.socket_timeout        = 0.1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.trace_requests        = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler.trace_sqlalchemy      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler_jaeger.process_tags   = {} {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] profiler_otlp.service_name_prefix = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.policy_default_rule = default {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.group          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.helper_command = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] privsep_osbrick.user           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.group         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.helper_command = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] cinder_sys_admin.user          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.auth_section      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.auth_type         = password {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.cafile            = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.certfile          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.collect_timing    = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.insecure          = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.keyfile           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.send_service_user_token = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.split_loggers     = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.timeout           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.tls_ciphers       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] service_user.tls_min_version   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.auth_section            = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.auth_type               = password {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.certfile                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.collect_timing          = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.insecure                = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.keyfile                 = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.region_name             = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.split_loggers           = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.timeout                 = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.tls_ciphers             = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] glance.tls_min_version         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.backend_availability_zone = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.chap_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.chap_username =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.disk_geometry = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.driver_client_cert = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.driver_data_namespace = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.driver_use_ssl = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.extra_capabilities = {} {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.filter_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.goodness_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.iscsi_target_flags =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.iser_port     = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_host      =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_login     = admin {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_mount_options = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_password  = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_private_key =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_share_path =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.replication_device = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.report_discard_supported = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.target_helper = tgtadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.target_port   = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.target_protocol = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.trace_flags   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.use_chap_auth = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_backend_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_clear  = zero {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_reports.file_event_handler = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_reports.log_dir           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.backend_host         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.chap_password        = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.chap_username        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.disk_geometry        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.driver_client_cert   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.extra_capabilities   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.filter_function      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.goodness_function    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.iser_helper          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.iser_ip_address      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.iser_port            = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_host             = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_login            = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_mount_options    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_password         = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_private_key      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_share_path       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.num_shell_tries      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.replication_device   = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.report_discard_supported = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.reserved_percentage  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.scst_target_driver   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.storage_protocol     = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.target_helper        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86764) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.target_ip_address    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86764]: WARNING cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 30 17:50:23 devstack cinder-volume[86764]: WARNING cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.target_port          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.target_prefix        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.target_protocol      = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Running cmd (subprocess): mount.quobyte {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.trace_flags          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.use_chap_auth        = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_clear         = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_clear_size    = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] QuobyteHD.volumes_dir          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_notifications.driver = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] key_manager.fixed_key          = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.barbican_api_version  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.barbican_endpoint     = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.barbican_endpoint_type = public {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.barbican_region_name  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.cafile                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.certfile              = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.collect_timing        = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.insecure              = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.keyfile               = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.number_of_retries     = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.retry_delay           = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.send_service_user_token = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.split_loggers         = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.timeout               = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.tls_ciphers           = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.tls_min_version       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.verify_ssl            = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican.verify_ssl_path       = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.auth_section = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.auth_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.cafile   = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.collect_timing = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.keyfile  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.split_loggers = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.timeout  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.tls_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] barbican_service_user.tls_min_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.approle_role_id          = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.approle_secret_id        = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.auth_method              = approle {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.auth_path                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.kv_mountpoint            = secret {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.kv_path                  = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.kv_version               = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.namespace                = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.root_token_id            = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.ssl_ca_crt_file          = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.timeout                  = 60.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.token_file               = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.token_role               = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.use_ssl                  = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:23 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] ******************************************************************************** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 30 17:50:23 devstack quobyte-client[86769]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 17:50:23 devstack quobyte-client[86769]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=86764) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:23 devstack cinder-volume[86764]: INFO cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f ...
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 -c /etc/quobyte/client-cinder.cfg {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:23 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 -c /etc/quobyte/client-cinder.cfg
Sep 30 17:50:23 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:23 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.459s {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:23 devstack cinder-volume[86764]: INFO cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f succeeded
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=86764) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.473s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:23 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:23 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:23 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:24 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.255s {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:24 devstack cinder-volume[86764]: INFO cinder.volume.driver [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.volume.driver [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9045333862305, 'free_capacity_gb': 1774.9045333862305, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86764) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_db.sqlalchemy.engines [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86764) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG dbcounter [-] [86764] Writer thread running {{(pid=86764) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.db.api [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Building query based on filter {{(pid=86764) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.image.image_utils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86764) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 30 17:50:24 devstack cinder-volume[86764]: INFO cinder.keymgr.migration [None req-4a358d87-648b-413f-bda9-6b64051a34cf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=86764) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=86764) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:24 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:24 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:24 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.297s {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Notifying Schedulers of capabilities ... {{(pid=86764) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:50:24 devstack cinder-volume[86764]: INFO cinder.volume.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Driver initialization completed successfully.
Sep 30 17:50:24 devstack cinder-volume[86764]: INFO cinder.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Initiating service 3 cleanup
Sep 30 17:50:24 devstack cinder-volume[86764]: INFO cinder.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Service 3 cleanup completed.
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.service [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Creating RPC server for service cinder-volume {{(pid=86764) start /opt/stack/cinder/cinder/service.py:231}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.service [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86764) start /opt/stack/cinder/cinder/service.py:237}}
Sep 30 17:50:24 devstack cinder-volume[86764]: INFO cinder.volume.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=86764) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=86764) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:24 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:24 devstack sudo[86904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:24 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:25 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:25 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.583s {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:25 devstack cinder-volume[86764]: INFO cinder.volume.manager [None req-507b3b9f-06a3-4352-9d99-f625b9eb0b1f None None] Driver post RPC initialization completed successfully.
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=86764) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG cinder.volume.drivers.quobyte [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=86764) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86764) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:28 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:28 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:28 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG oslo_concurrency.processutils [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.230s {{(pid=86764) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:28 devstack cinder-volume[86764]: DEBUG cinder.manager [None req-8e84d4f1-33ac-457a-b225-095e14cd4087 None None] Notifying Schedulers of capabilities ... {{(pid=86764) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:50:30 devstack cinder-volume[86542]: INFO oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Caught SIGTERM, stopping children
Sep 30 17:50:30 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Acquiring lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:50:30 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Acquired lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:50:30 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Releasing lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:50:30 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Stop services. {{(pid=86542) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 30 17:50:30 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Killing children. {{(pid=86542) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 30 17:50:30 devstack cinder-volume[86542]: INFO oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Waiting on 1 children to exit
Sep 30 17:50:33 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Acquiring lock "singleton_lock" {{(pid=86764) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:50:33 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Acquired lock "singleton_lock" {{(pid=86764) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:50:33 devstack cinder-volume[86764]: DEBUG oslo_concurrency.lockutils [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Releasing lock "singleton_lock" {{(pid=86764) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:50:33 devstack cinder-volume[86764]: WARNING amqp [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 17:50:33 devstack cinder-volume[86764]: WARNING amqp [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 17:50:33 devstack cinder-volume[86542]: INFO oslo_service.backend._eventlet.service [None req-b6be1582-493a-49ed-bfd1-71e02dfb97c9 None None] Child 86764 exited with status 0
Sep 30 17:50:33 devstack cinder-volume[87096]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 30 17:50:33 devstack cinder-volume[87096]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 30 17:50:33 devstack cinder-volume[87096]: we strongly recommend against using it for new projects.
Sep 30 17:50:33 devstack cinder-volume[87096]: If you are already using Eventlet, we recommend migrating to a different
Sep 30 17:50:33 devstack cinder-volume[87096]: framework.  For more detail see
Sep 30 17:50:33 devstack cinder-volume[87096]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 30 17:50:33 devstack cinder-volume[87096]:   import eventlet  # noqa
Sep 30 17:50:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87096) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 30 17:50:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87096) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 30 17:50:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87096) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 30 17:50:37 devstack cinder-volume[87096]: INFO dbcounter [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Registered counter for database cinder
Sep 30 17:50:37 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:37 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writer thread running {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 30 17:50:37 devstack cinder-volume[87096]: INFO cinder.rpc [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 17:50:37 devstack cinder-volume[87096]: INFO cinder.rpc [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 17:50:37 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Determined volume DB was empty at startup.
Sep 30 17:50:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87096) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 30 17:50:37 devstack cinder-volume[87096]: WARNING stevedore.named [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 17:50:37 devstack cinder-volume[87096]: WARNING castellan.key_manager [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:50:37 devstack cinder-volume[87096]: WARNING cinder.keymgr.conf_key_mgr [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 17:50:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:38 devstack cinder-volume[87096]: INFO oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Starting 1 workers
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Started child 87418 {{(pid=87096) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Full set of CONF: {{(pid=87096) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] ******************************************************************************** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] Configuration options gathered from: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] ================================================================================ {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] allow_availability_zone_fallback = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] allow_compression_on_image_upload = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] allowed_direct_url_schemes     = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] api_rate_limit                 = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] auth_strategy                  = keystone {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_availability_zone      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_host                   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_name                   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_stats_polling_interval = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backup_api_class               = cinder.backup.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backup_name_template           = backup-%s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backup_use_same_host           = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backup_use_temp_snapshot       = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] chap_password                  = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] chap_username                  =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_internal_tenant_project_id = a87db87456794ab0850ada3dcfb73e55 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_internal_tenant_user_id = 4983fc29886b4cfe82febc7c244bbe74 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cluster                        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] compression_format             = gzip {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] compute_api_class              = cinder.compute.nova.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] config_dir                     = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] config_source                  = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] control_exchange               = openstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] debug                          = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] default_availability_zone      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] default_group_type             = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] default_volume_type            = QuobyteHD {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] disk_geometry                  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] driver_client_cert             = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] driver_client_cert_key         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] driver_data_namespace          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] driver_ssl_cert_path           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] driver_ssl_cert_verify         = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] driver_use_ssl                 = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] enable_new_services            = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] enable_unsupported_driver      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] enabled_backends               = ['QuobyteHD'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] enforce_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] filter_function                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_api_insecure            = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_api_servers             = ['http://192.168.122.25/image'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_api_ssl_compression     = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_ca_certificates_file    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_catalog_info            = image:glance:publicURL {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_certfile                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_keyfile                 = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_num_retries             = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance_request_timeout         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] goodness_function              = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] graceful_shutdown_timeout      = 5 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] group_api_class                = cinder.group.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] host                           = devstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_compress_on_upload       = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_conversion_address_space_limit = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_conversion_cpu_limit     = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_conversion_disable       = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_introspection_address_space_limit = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_introspection_cpu_limit  = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_upload_use_cinder_backend = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_upload_use_internal_tenant = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_volume_cache_enabled     = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_volume_cache_max_count   = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] image_volume_cache_max_size_gb = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] init_host_max_objects_retrieval = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] instance_format                = [instance: %(uuid)s]  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] iscsi_target_flags             =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] iscsi_write_cache              = on {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87418) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] iser_helper                    = tgtadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] iser_ip_address                = 192.168.122.25 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] iser_port                      = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_color                      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_config_append              = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_dir                        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_file                       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_options                    = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_rotate_interval            = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_rotate_interval_type       = days {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] log_rotation_type              = none {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] max_age                        = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] max_logfile_count              = 30 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] max_logfile_size_mb            = 200 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] max_over_subscription_ratio    = 20.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] message_reap_interval          = 86400 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] message_ttl                    = 2592000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] migration_create_volume_timeout_secs = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] monkey_patch                   = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] monkey_patch_modules           = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] my_ip                          = 192.168.122.25 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] no_snapshot_gb_quota           = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] num_iser_scan_tries            = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] num_shell_tries                = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] num_volume_device_scan_tries   = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] nvmeof_conn_info_version       = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] nvmet_ns_id                    = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] nvmet_port_id                  = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_max_limit                = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_volume_ext_list          = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_volume_listen_port       = 8776 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_volume_use_ssl           = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] osapi_volume_workers           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] per_volume_size_limit          = -1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] periodic_fuzzy_delay           = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] periodic_interval              = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] public_endpoint                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] publish_errors                 = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_backup_gigabytes         = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_backups                  = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_gigabytes                = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_groups                   = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_snapshots                = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] quota_volumes                  = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] rate_limit_burst               = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] rate_limit_except_level        = CRITICAL {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] rate_limit_interval            = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] reinit_driver_count            = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] replication_device             = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] report_discard_supported       = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] report_interval                = 120 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] reservation_clean_interval     = 86400 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] reservation_expire             = 86400 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] reserved_image_namespaces      = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] reserved_percentage            = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] rpc_response_timeout           = 120 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] run_external_periodic_tasks    = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] scst_target_driver             = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] scst_target_iqn_name           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_down_time              = 720 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] shell_completion               = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] snapshot_name_template         = snapshot-%s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] split_loggers                  = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] state_path                     = /opt/stack/data/cinder {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] storage_availability_zone      = nova {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] storage_protocol               = iSCSI {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] syslog_log_facility            = LOG_USER {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] target_helper                  = lioadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] target_ip_address              = 192.168.122.25 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] target_port                    = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] target_protocol                = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] target_secondary_ip_addresses  = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] trace_flags                    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] transport_url                  = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] until_refresh                  = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_chap_auth                  = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_default_quota_class        = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_journal                    = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_json                       = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_multipath_for_image_xfer   = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_stderr                     = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] use_syslog                     = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] verify_glance_signatures       = enabled {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_api_class               = cinder.volume.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_backend_name            = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_clear                   = zero {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_clear_ionice            = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_clear_size              = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_copy_bps_limit          = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_dd_blocksize            = 1M {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_name_template           = volume-%s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87418) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 30 17:50:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 30 17:50:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_service_inithost_offload = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volume_usage_audit_period      = month {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] zoning_mode                    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Running cmd (subprocess): mount.quobyte {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_concurrency.disable_process_locking = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.auth_section = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.auth_type   = password {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.auth_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.cache       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.certfile    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.include_service_catalog = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.insecure    = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.interface   = public {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.keyfile     = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcache_username = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.region_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.service_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.backend                  = dogpile.cache.null {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.backend_argument         = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.backend_expiration_time  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.config_prefix            = cache.oslo {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.debug_cache_backend      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.enable_retry_client      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.enable_socket_keepalive  = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.enabled                  = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.expiration_time          = 600 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.hashclient_retry_attempts = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_dead_retry      = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_pool_maxsize    = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_sasl_enabled    = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.password                 = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.proxies                  = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.redis_db                 = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.redis_server             = localhost:6379 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.retry_attempts           = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.retry_delay              = 0.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.socket_keepalive_count   = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.socket_keepalive_idle    = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.socket_keepalive_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.socket_timeout           = 1.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.tls_allowed_ciphers      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.tls_cafile               = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.tls_certfile             = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.tls_enabled              = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.tls_keyfile              = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cache.username                 = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] coordination.backend_url       = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.asyncio_connection    = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.asyncio_slave_connection = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.backend               = sqlalchemy {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.connection            = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.connection_debug      = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.connection_parameters =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.connection_recycle_time = 3600 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.connection_trace      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.db_inc_retry_interval = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.db_max_retries        = 20 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.db_max_retry_interval = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.db_retry_interval     = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.max_overflow          = 50 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.max_pool_size         = 5 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.max_retries           = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.mysql_wsrep_sync_wait = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.pool_timeout          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.retry_interval        = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.slave_connection      = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.sqlite_synchronous    = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.synchronous_reader    = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] database.use_db_reconnect      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_tracing.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.connection_string     = messaging:// {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.enabled               = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.es_doc_type           = notification {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.es_scroll_size        = 10000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.es_scroll_time        = 2m {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.filter_error_trace    = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.hmac_keys             = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.sentinel_service_name = mymaster {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.socket_timeout        = 0.1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.trace_requests        = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler.trace_sqlalchemy      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler_jaeger.process_tags   = {} {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler_jaeger.service_name_prefix = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] profiler_otlp.service_name_prefix = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.enforce_new_defaults = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.policy_default_rule = default {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.policy_file        = policy.yaml {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.group          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.helper_command = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack quobyte-client[87419]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 17:50:38 devstack quobyte-client[87419]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] privsep_osbrick.user           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.group         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.helper_command = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] cinder_sys_admin.user          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.auth_section      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.auth_type         = password {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.cafile            = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.certfile          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.collect_timing    = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.insecure          = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.keyfile           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.send_service_user_token = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.split_loggers     = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.timeout           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.tls_ciphers       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] service_user.tls_min_version   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.auth_section            = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.auth_type               = password {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.certfile                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.collect_timing          = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.insecure                = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.keyfile                 = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.region_name             = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.split_loggers           = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.timeout                 = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.tls_ciphers             = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] glance.tls_min_version         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.backend_availability_zone = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.chap_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.chap_username =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.disk_geometry = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.driver_client_cert = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.driver_client_cert_key = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.driver_data_namespace = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.driver_use_ssl = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.extra_capabilities = {} {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.filter_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.goodness_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.iscsi_target_flags =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.iscsi_write_cache = on {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.iser_helper   = tgtadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.iser_port     = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_host      =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_login     = admin {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_mount_options = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_password  = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_private_key =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_share_path =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.num_shell_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.quobyte_volume_url = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.replication_device = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.report_discard_supported = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.reserved_percentage = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.target_helper = tgtadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.target_port   = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.target_protocol = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.trace_flags   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.unique_fqdn_network = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.use_chap_auth = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_backend_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_clear  = zero {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_clear_ionice = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_clear_size = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_reports.file_event_handler = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_reports.log_dir           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.backend_availability_zone = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.backend_host         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.chap_password        = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.chap_username        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.chiscsi_conf         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.disk_geometry        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.driver_client_cert   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.driver_data_namespace = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.driver_use_ssl       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.extra_capabilities   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.filter_function      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.goodness_function    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.iser_helper          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.iser_ip_address      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.iser_port            = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.iser_target_prefix   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_host             = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_login            = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_mount_options    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_password         = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_private_key      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_share_path       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_ssh_port         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.num_shell_tries      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.nvmet_port_id        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.replication_device   = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.report_discard_supported = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.reserved_percentage  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.scst_target_driver   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.storage_protocol     = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.target_helper        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.target_ip_address    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.target_port          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.target_prefix        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.target_protocol      = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.trace_flags          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.use_chap_auth        = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_clear         = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_clear_size    = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] QuobyteHD.volumes_dir          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl      = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_notifications.driver = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_notifications.retry = -1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] key_manager.fixed_key          = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.barbican_api_version  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.barbican_endpoint     = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.barbican_endpoint_type = public {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.barbican_region_name  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.cafile                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.certfile              = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.collect_timing        = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.insecure              = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.keyfile               = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.number_of_retries     = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.retry_delay           = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.send_service_user_token = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.split_loggers         = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.timeout               = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.tls_ciphers           = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.tls_min_version       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.verify_ssl            = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican.verify_ssl_path       = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.auth_section = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.auth_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.cafile   = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.collect_timing = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.keyfile  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.split_loggers = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.timeout  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.tls_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] barbican_service_user.tls_min_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.approle_role_id          = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.approle_secret_id        = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.auth_method              = approle {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.auth_path                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.kv_mountpoint            = secret {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.kv_path                  = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.kv_version               = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.namespace                = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.root_token_id            = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.ssl_ca_crt_file          = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.timeout                  = 60.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.token_file               = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.token_role               = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.use_ssl                  = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 30 17:50:38 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-755c6d6a-b0d5-424e-b4b1-1ea1fe96ae2b None None] ******************************************************************************** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 30 17:50:38 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.volume.driver [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.driver [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9045333862305, 'free_capacity_gb': 1774.9045333862305, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87418) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_db.sqlalchemy.engines [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87418) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writer thread running {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.db.api [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Building query based on filter {{(pid=87418) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87418) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.keymgr.migration [None req-fe3881ad-b1a3-4c38-aada-999536e62a46 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 17:50:38 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:38 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:38 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.224s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Driver initialization completed successfully.
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Initiating service 3 cleanup
Sep 30 17:50:38 devstack cinder-volume[87418]: INFO cinder.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Service 3 cleanup completed.
Sep 30 17:50:38 devstack cinder-volume[87418]: DEBUG cinder.service [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Creating RPC server for service cinder-volume {{(pid=87418) start /opt/stack/cinder/cinder/service.py:231}}
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG cinder.service [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87418) start /opt/stack/cinder/cinder/service.py:237}}
Sep 30 17:50:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:50:39 devstack sudo[87442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:50:39 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:50:39 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root
Sep 30 17:50:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.237s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:50:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-21e14d13-efd5-4bcf-975e-cfa33c5054cd None None] Driver post RPC initialization completed successfully.
Sep 30 17:50:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:50:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 6 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:50:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:50:48 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:50:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:50:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=2 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:51:46 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:51:46 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:51:46 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.578s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 6 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:51:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:51:53 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:51:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Flow 'volume_create_manager' (cf2d87b4-0faf-46aa-ae85-253a0a237755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f83d73d-3b7d-4457-8e63-49b6b0aa8631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f83d73d-3b7d-4457-8e63-49b6b0aa8631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-567020271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce31837963ba4b76b535519715241068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:51:54Z,use_quota=True,user_id='825cf17d44c046b9832e6d98c0244492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1842f2f-8f2b-48b3-8c5c-75549c8c5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1842f2f-8f2b-48b3-8c5c-75549c8c5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edd5c22-80f6-44e8-a015-6da82aac7029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edd5c22-80f6-44e8-a015-6da82aac7029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f', 'volume_name': 'volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158094c-0c81-48d7-afa3-a243a7675d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158094c-0c81-48d7-afa3-a243a7675d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40b1b51-f3cf-4be3-9bc0-2a05157b9b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:51:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Volume 0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f', 'volume_size': 1}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-567020271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce31837963ba4b76b535519715241068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:51:54Z,use_quota=True,user_id='825cf17d44c046b9832e6d98c0244492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Creating volume 0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:51:54 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:51:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:51:54 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f 1073741824
Sep 30 17:51:54 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:51:55 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Sep 30 17:51:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f 1073741824" returned: 0 in 1.226s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:51:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:51:55 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f
Sep 30 17:51:55 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:51:56 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f" returned: 0 in 0.634s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40b1b51-f3cf-4be3-9bc0-2a05157b9b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9ff4ec-9037-4453-b5c2-fcb7fafdd36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:51:56 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Volume volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f (0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f): created successfully
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9ff4ec-9037-4453-b5c2-fcb7fafdd36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:51:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Flow 'volume_create_manager' (cf2d87b4-0faf-46aa-ae85-253a0a237755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:51:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c6a9dc1a-5c2e-4a20-9ed8-46fbf6e3280f tempest-DeleteServersTestJSON-1247043574 None] Created volume successfully.
Sep 30 17:52:03 devstack cinder-volume[87418]: WARNING py.warnings [req-24eaab96-59e6-4176-ae5d-c4c41d462dd1 req-5d22b1ab-499f-453f-84b4-afe904a9c798 tempest-DeleteServersTestJSON-1247043574 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 30 17:52:03 devstack cinder-volume[87418]:   .first()
Sep 30 17:52:03 devstack cinder-volume[87418]: 
Sep 30 17:52:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-24eaab96-59e6-4176-ae5d-c4c41d462dd1 req-5d22b1ab-499f-453f-84b4-afe904a9c798 tempest-DeleteServersTestJSON-1247043574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-24eaab96-59e6-4176-ae5d-c4c41d462dd1 req-5d22b1ab-499f-453f-84b4-afe904a9c798 tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-24eaab96-59e6-4176-ae5d-c4c41d462dd1 req-5d22b1ab-499f-453f-84b4-afe904a9c798 tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-24eaab96-59e6-4176-ae5d-c4c41d462dd1 req-5d22b1ab-499f-453f-84b4-afe904a9c798 tempest-DeleteServersTestJSON-1247043574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7c45014-efe1-4a60-a752-9e1a411ea678', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:52:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-24eaab96-59e6-4176-ae5d-c4c41d462dd1 req-5d22b1ab-499f-453f-84b4-afe904a9c798 tempest-DeleteServersTestJSON-1247043574 None] attachment_update completed successfully.
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Flow 'volume_create_manager' (8106361a-1955-4b52-8235-47e021e47517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd687a1-4f58-4c98-b617-8cbb8b8a65c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd687a1-4f58-4c98-b617-8cbb8b8a65c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-463027902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eae75b8-923f-4b2f-ad39-5baa60949b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d5c5ce2f52411e9b8ae801cc30cdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:06Z,use_quota=True,user_id='b4a5907d0cba4942b27ea94a2b9df33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb8151f-d6a6-44df-8a4b-49623390228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb8151f-d6a6-44df-8a4b-49623390228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6d127e-7da2-46b3-a027-58611d1eba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6d127e-7da2-46b3-a027-58611d1eba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eae75b8-923f-4b2f-ad39-5baa60949b9d', 'volume_name': 'volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b05c78-4378-4cbd-8458-76583eb88e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b05c78-4378-4cbd-8458-76583eb88e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce4e732-4612-4efc-9ec4-ecaaadf32a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Volume 6eae75b8-923f-4b2f-ad39-5baa60949b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d', 'volume_size': 1}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-463027902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eae75b8-923f-4b2f-ad39-5baa60949b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d5c5ce2f52411e9b8ae801cc30cdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:06Z,use_quota=True,user_id='b4a5907d0cba4942b27ea94a2b9df33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Creating volume 6eae75b8-923f-4b2f-ad39-5baa60949b9d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:52:06 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:52:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:06 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d 1073741824
Sep 30 17:52:06 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:07 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d 1073741824" returned: 0 in 0.832s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:07 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d
Sep 30 17:52:07 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:08 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d" returned: 0 in 0.492s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce4e732-4612-4efc-9ec4-ecaaadf32a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef87319-2493-449a-85e2-6a02e13c4003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Volume volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d (6eae75b8-923f-4b2f-ad39-5baa60949b9d): created successfully
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef87319-2493-449a-85e2-6a02e13c4003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Flow 'volume_create_manager' (8106361a-1955-4b52-8235-47e021e47517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-75aeb6bd-c214-4898-ac31-72676c64939a tempest-VolumesAdminNegativeTest-1767557147 None] Created volume successfully.
Sep 30 17:52:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Acquiring lock "cinder-6eae75b8-923f-4b2f-ad39-5baa60949b9d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Lock "cinder-6eae75b8-923f-4b2f-ad39-5baa60949b9d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Acquiring lock "cinder-quobyte-6eae75b8-923f-4b2f-ad39-5baa60949b9d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Lock "cinder-quobyte-6eae75b8-923f-4b2f-ad39-5baa60949b9d" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:11 devstack cinder-volume[87418]: INFO oslo.privsep.daemon [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj_ybo_o0/privsep.sock']
Sep 30 17:52:11 devstack sudo[89222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj_ybo_o0/privsep.sock
Sep 30 17:52:11 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-5860110d-9235-4af5-b573-0a08766c69eb req-64ecdc9e-347d-411f-a6fd-b331a7febebd tempest-DeleteServersTestJSON-1247043574 None] Terminate volume connection completed successfully.
Sep 30 17:52:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-5860110d-9235-4af5-b573-0a08766c69eb req-64ecdc9e-347d-411f-a6fd-b331a7febebd tempest-DeleteServersTestJSON-1247043574 None] Deleting attachment c7c45014-efe1-4a60-a752-9e1a411ea678. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 30 17:52:13 devstack cinder-volume[87418]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 30 17:52:14 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:14 devstack cinder-volume[87418]: INFO oslo.privsep.daemon [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Spawned new privsep daemon via rootwrap
Sep 30 17:52:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Accepted privsep connection to /tmp/tmpj_ybo_o0/privsep.sock {{(pid=87418) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 30 17:52:14 devstack cinder-volume[87418]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 30 17:52:14 devstack cinder-volume[87418]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 30 17:52:14 devstack cinder-volume[87418]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 30 17:52:14 devstack cinder-volume[87418]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89248
Sep 30 17:52:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6673b3-192e-43dd-80f8-066b1f69bbd2]: (2,) {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:52:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[429f8846-f7a5-46f0-863b-a80f84359bd9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:52:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:14 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d
Sep 30 17:52:14 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:14 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d" returned: 0 in 0.723s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:14 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d
Sep 30 17:52:14 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:15 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6eae75b8-923f-4b2f-ad39-5baa60949b9d" returned: 0 in 0.504s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Lock "cinder-quobyte-6eae75b8-923f-4b2f-ad39-5baa60949b9d" released by "delete_volume" :: held 4.298s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:15 devstack cinder-volume[87418]: WARNING cinder.quota [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:52:15 devstack cinder-volume[87418]: WARNING cinder.quota [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Created reservations ['6eeaf4a3-0bba-40e8-b841-9dd426eb20bb', '4feb04be-2379-4029-bce2-e8f4726dfb57', '2ab70fc2-9dca-4956-a958-c0799ffd3e9a', '6f8f1030-9272-4da9-b5ad-f6a3ab886452'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Acquiring lock "cinder-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Lock "cinder-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:15 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:52:15 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Acquiring lock "cinder-quobyte-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Lock "cinder-quobyte-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4bd147-51ed-4261-a78a-27c50c02df0d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:52:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:16 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f
Sep 30 17:52:16 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:16 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.668s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:16 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:52:16 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Deleted volume successfully.
Sep 30 17:52:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c287fae5-6e15-48a7-a9c4-14001b944118 tempest-VolumesAdminNegativeTest-1767557147 None] Lock "cinder-6eae75b8-923f-4b2f-ad39-5baa60949b9d-delete_volume" released by "delete_volume" :: held 5.680s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:17 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f" returned: 0 in 1.069s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:17 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f
Sep 30 17:52:17 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:17 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f" returned: 0 in 0.669s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Lock "cinder-quobyte-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f" released by "delete_volume" :: held 1.831s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:17 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Created reservations ['b47d9657-e954-45af-8aa7-72782975c723', '6c34258f-4d40-4f9c-898a-bf2674dc9fef', '0c9ff0b3-e072-487c-ba83-ac3e0d0ef47b', '2f3ab38f-27cc-44d9-9684-d81465ff7dd3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:18 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:52:18 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:18 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.640s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:52:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Deleted volume successfully.
Sep 30 17:52:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8b8c9df-ff9e-4890-a4bd-3bec2ab113f5 tempest-DeleteServersTestJSON-1247043574 None] Lock "cinder-0e9ee7bc-b5d7-4fe0-957c-6bea218eb09f-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Flow 'volume_create_manager' (252849aa-07c6-431d-82d8-a09e84e1df77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85a6f3e-7903-4e05-8850-bca8a98e4976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85a6f3e-7903-4e05-8850-bca8a98e4976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-704113384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6942cedd-35a1-4219-8067-f7945d352347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793f38600ea4295a4bdea3088205017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:27Z,use_quota=True,user_id='f22b8572988b4be9adf8bb3ebcf32855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033bcddb-2e43-4322-9daa-9a45a3dba6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033bcddb-2e43-4322-9daa-9a45a3dba6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895e1181-e359-45a9-8691-54fda3d794bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895e1181-e359-45a9-8691-54fda3d794bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6942cedd-35a1-4219-8067-f7945d352347', 'volume_name': 'volume-6942cedd-35a1-4219-8067-f7945d352347', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45883e6a-3863-41c1-85b2-5ff83e3284a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45883e6a-3863-41c1-85b2-5ff83e3284a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983978cd-cf78-4baa-b94c-2c4b8b36382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Volume 6942cedd-35a1-4219-8067-f7945d352347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6942cedd-35a1-4219-8067-f7945d352347', 'volume_size': 1}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-704113384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6942cedd-35a1-4219-8067-f7945d352347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793f38600ea4295a4bdea3088205017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:27Z,use_quota=True,user_id='f22b8572988b4be9adf8bb3ebcf32855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Creating volume 6942cedd-35a1-4219-8067-f7945d352347 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:52:26 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:52:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:26 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347 1073741824
Sep 30 17:52:26 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:27 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347 1073741824" returned: 0 in 0.537s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:27 devstack sudo[89371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347
Sep 30 17:52:27 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:27 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347" returned: 0 in 0.316s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983978cd-cf78-4baa-b94c-2c4b8b36382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6942cedd-35a1-4219-8067-f7945d352347', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4d0366-94b9-480c-80f2-a86d496d4241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Volume volume-6942cedd-35a1-4219-8067-f7945d352347 (6942cedd-35a1-4219-8067-f7945d352347): created successfully
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4d0366-94b9-480c-80f2-a86d496d4241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Flow 'volume_create_manager' (252849aa-07c6-431d-82d8-a09e84e1df77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1da81092-38b4-400f-8229-d7d9bb6374da tempest-ServersNegativeTestJSON-33834358 None] Created volume successfully.
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Flow 'volume_create_manager' (a9211fe5-81c3-470c-8452-19863308b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a093f0a9-64d6-4577-9732-c7e89077748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a093f0a9-64d6-4577-9732-c7e89077748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1491022198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1031939b-e7c3-4752-ac5d-080aa8e27002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793f38600ea4295a4bdea3088205017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:32Z,use_quota=True,user_id='f22b8572988b4be9adf8bb3ebcf32855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e589cf-014f-41ef-8450-15c69196cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e589cf-014f-41ef-8450-15c69196cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815e6c2d-6ec7-4108-87f9-bb814192effa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815e6c2d-6ec7-4108-87f9-bb814192effa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1031939b-e7c3-4752-ac5d-080aa8e27002', 'volume_name': 'volume-1031939b-e7c3-4752-ac5d-080aa8e27002', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65f937f-ba83-4b16-b067-54849284e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65f937f-ba83-4b16-b067-54849284e488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd4840a-0ee1-4538-9be1-2974643fd01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Volume 1031939b-e7c3-4752-ac5d-080aa8e27002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1031939b-e7c3-4752-ac5d-080aa8e27002', 'volume_size': 1}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1491022198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1031939b-e7c3-4752-ac5d-080aa8e27002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793f38600ea4295a4bdea3088205017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:32Z,use_quota=True,user_id='f22b8572988b4be9adf8bb3ebcf32855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Creating volume 1031939b-e7c3-4752-ac5d-080aa8e27002 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:52:31 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:52:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:31 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002 1073741824
Sep 30 17:52:31 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:32 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002 1073741824" returned: 0 in 0.540s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:32 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002
Sep 30 17:52:32 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:32 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002" returned: 0 in 0.316s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd4840a-0ee1-4538-9be1-2974643fd01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1031939b-e7c3-4752-ac5d-080aa8e27002', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08fb3cb-33f3-45de-9ad8-a64aed990bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:32 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Volume volume-1031939b-e7c3-4752-ac5d-080aa8e27002 (1031939b-e7c3-4752-ac5d-080aa8e27002): created successfully
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08fb3cb-33f3-45de-9ad8-a64aed990bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Flow 'volume_create_manager' (a9211fe5-81c3-470c-8452-19863308b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b55d603c-e554-4364-a2c5-499bceacd0da tempest-ServersNegativeTestJSON-33834358 None] Created volume successfully.
Sep 30 17:52:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "cinder-1031939b-e7c3-4752-ac5d-080aa8e27002-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-1031939b-e7c3-4752-ac5d-080aa8e27002-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "cinder-quobyte-1031939b-e7c3-4752-ac5d-080aa8e27002" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-quobyte-1031939b-e7c3-4752-ac5d-080aa8e27002" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ff0edc-d415-45ac-8a74-3d965a6d730b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:52:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:36 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002
Sep 30 17:52:36 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:37 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002" returned: 0 in 0.389s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:37 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002
Sep 30 17:52:37 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:37 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1031939b-e7c3-4752-ac5d-080aa8e27002" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-quobyte-1031939b-e7c3-4752-ac5d-080aa8e27002" released by "delete_volume" :: held 0.711s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Created reservations ['c72a005f-f450-4786-882d-b8c977de8043', '29c0a62e-2b78-4a79-b5f3-413fbf826c84', 'b4299a10-adc3-415f-bfab-4837b2a038c3', 'f5cdf3eb-264c-4dae-aa3e-a721ed6f3733'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:37 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:52:37 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:37 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "cinder-6942cedd-35a1-4219-8067-f7945d352347-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.303s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:52:37 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Deleted volume successfully.
Sep 30 17:52:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-6942cedd-35a1-4219-8067-f7945d352347-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cd377ed9-6d5d-4b8e-b42e-add75130f3ed tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-1031939b-e7c3-4752-ac5d-080aa8e27002-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "cinder-quobyte-6942cedd-35a1-4219-8067-f7945d352347" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-quobyte-6942cedd-35a1-4219-8067-f7945d352347" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeb59fb-fc6a-4fbf-af84-0a44e93a9c15]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:38 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347
Sep 30 17:52:38 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:38 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:38 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347
Sep 30 17:52:38 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:38 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6942cedd-35a1-4219-8067-f7945d352347" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-quobyte-6942cedd-35a1-4219-8067-f7945d352347" released by "delete_volume" :: held 0.760s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:38 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Created reservations ['be4164f2-42de-4471-8983-ef7c8f6b1b0c', '39852ffa-05d5-416c-9d9c-0308fc10f0e8', '94780caf-7124-418f-8568-c46c173c777e', '4b73f12c-bf19-4a59-bcf9-e44e4160fa59'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:39 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:52:39 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:39 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.377s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:52:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Deleted volume successfully.
Sep 30 17:52:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-34aae462-3a87-4bf5-bf35-68e8fcf6cb83 tempest-ServersNegativeTestJSON-33834358 None] Lock "cinder-6942cedd-35a1-4219-8067-f7945d352347-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:46 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:52:46 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:46 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.307s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:52:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=40,cinder:UPDATE=46,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:52:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=32,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Flow 'volume_create_manager' (4a5b9c95-9cb6-4bb1-9a12-0d58bc91231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab2471c-c30b-455b-85b8-98a15530c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab2471c-c30b-455b-85b8-98a15530c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-112597864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f702a19-389e-49c4-9af9-7ce21098612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91eae8cd975493495be3f0f5d47b093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:51Z,use_quota=True,user_id='fc04d10375d84ee4bb24c745701e9e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8400b8e-0f54-4e39-b3df-81e9564b91ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8400b8e-0f54-4e39-b3df-81e9564b91ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2a8602-689d-4943-b4eb-988f7af1f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2a8602-689d-4943-b4eb-988f7af1f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f702a19-389e-49c4-9af9-7ce21098612b', 'volume_name': 'volume-6f702a19-389e-49c4-9af9-7ce21098612b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08aedfdf-99ec-4ad2-badb-17034d1f7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08aedfdf-99ec-4ad2-badb-17034d1f7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76d18c4-978d-4b62-a488-b975e9d1a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Volume 6f702a19-389e-49c4-9af9-7ce21098612b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f702a19-389e-49c4-9af9-7ce21098612b', 'volume_size': 1}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-112597864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f702a19-389e-49c4-9af9-7ce21098612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91eae8cd975493495be3f0f5d47b093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:52:51Z,use_quota=True,user_id='fc04d10375d84ee4bb24c745701e9e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Creating volume 6f702a19-389e-49c4-9af9-7ce21098612b {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:52:50 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:52:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:50 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b 1073741824
Sep 30 17:52:50 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:51 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b 1073741824" returned: 0 in 0.514s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:52:51 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b
Sep 30 17:52:51 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:52:51 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b" returned: 0 in 0.277s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76d18c4-978d-4b62-a488-b975e9d1a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f702a19-389e-49c4-9af9-7ce21098612b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4619a6-7e84-4fce-9409-9747d9f29f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:52:51 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Volume volume-6f702a19-389e-49c4-9af9-7ce21098612b (6f702a19-389e-49c4-9af9-7ce21098612b): created successfully
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4619a6-7e84-4fce-9409-9747d9f29f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:52:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Flow 'volume_create_manager' (4a5b9c95-9cb6-4bb1-9a12-0d58bc91231f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:52:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e6858c41-251b-4e67-ac00-5b7e7fc22b03 tempest-TaggedAttachmentsTest-1247537616 None] Created volume successfully.
Sep 30 17:53:01 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:53:01 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Flow 'volume_create_manager' (61742ca6-4193-4bf7-8165-47e97197d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1afc1af-ef94-4cb9-95de-8a2cb65a7d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1afc1af-ef94-4cb9-95de-8a2cb65a7d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1876196181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f1c370-47e0-4146-8312-be0dc54c802b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca0fe587cf4e5f908f10b500be7e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:53:38Z,use_quota=True,user_id='fdb244f08c794755883d594ad737fb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e160f9f-ed22-4b62-880a-d91599f12dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e160f9f-ed22-4b62-880a-d91599f12dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408630db-b5d5-454d-9d48-9f0c817dbe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408630db-b5d5-454d-9d48-9f0c817dbe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f1c370-47e0-4146-8312-be0dc54c802b', 'volume_name': 'volume-84f1c370-47e0-4146-8312-be0dc54c802b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe439d0-caec-4a72-bf3b-b323db3015cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe439d0-caec-4a72-bf3b-b323db3015cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d537cce-6a72-47d8-93cc-747ddf4fe37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:38 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Volume 84f1c370-47e0-4146-8312-be0dc54c802b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f1c370-47e0-4146-8312-be0dc54c802b', 'volume_size': 1}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1876196181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f1c370-47e0-4146-8312-be0dc54c802b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca0fe587cf4e5f908f10b500be7e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:53:38Z,use_quota=True,user_id='fdb244f08c794755883d594ad737fb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Creating volume 84f1c370-47e0-4146-8312-be0dc54c802b {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:53:38 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:53:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:53:38 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b 1073741824
Sep 30 17:53:38 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:53:39 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Sep 30 17:53:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b 1073741824" returned: 0 in 1.058s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:53:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:53:39 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b
Sep 30 17:53:39 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:53:40 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b" returned: 0 in 0.777s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d537cce-6a72-47d8-93cc-747ddf4fe37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f1c370-47e0-4146-8312-be0dc54c802b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53a9a5d-ef68-4cde-9f00-616756ab453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:40 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Volume volume-84f1c370-47e0-4146-8312-be0dc54c802b (84f1c370-47e0-4146-8312-be0dc54c802b): created successfully
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53a9a5d-ef68-4cde-9f00-616756ab453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Flow 'volume_create_manager' (61742ca6-4193-4bf7-8165-47e97197d39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:53:40 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8184522f-93eb-4c03-be7f-1703278331b8 tempest-ServerActionsTestOtherA-1846242258 None] Created volume successfully.
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:53:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:53:46 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:53:46 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:53:47 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Sep 30 17:53:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.835s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:53:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:53:47 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:53:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 8 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:53:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:53:50 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:53:50 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Flow 'volume_create_manager' (1e19a5ee-d2d6-443c-beca-71c12ed1eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85695f83-a4e7-4644-a14b-addcb1b4cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85695f83-a4e7-4644-a14b-addcb1b4cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1105186283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3971122-a7e9-4f8a-8465-4c5495456954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163f4e5c7cfa4ed095023f1ae42cdbb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:53:56Z,use_quota=True,user_id='b1810ded74ac46a5b993f44fbb616ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8195c0a4-7aef-4a15-8215-ef869f651a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8195c0a4-7aef-4a15-8215-ef869f651a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fb347a-0a7c-4ffe-bd69-6bb1b802274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fb347a-0a7c-4ffe-bd69-6bb1b802274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3971122-a7e9-4f8a-8465-4c5495456954', 'volume_name': 'volume-a3971122-a7e9-4f8a-8465-4c5495456954', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeeb2a9-f098-4bb2-82c8-2091b5039b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeeb2a9-f098-4bb2-82c8-2091b5039b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efdf500-784b-44f1-b167-ee49a5317275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:56 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Volume a3971122-a7e9-4f8a-8465-4c5495456954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3971122-a7e9-4f8a-8465-4c5495456954', 'volume_size': 1}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1105186283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3971122-a7e9-4f8a-8465-4c5495456954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163f4e5c7cfa4ed095023f1ae42cdbb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:53:56Z,use_quota=True,user_id='b1810ded74ac46a5b993f44fbb616ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Creating volume a3971122-a7e9-4f8a-8465-4c5495456954 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:53:56 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:53:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:53:56 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954 1073741824
Sep 30 17:53:56 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:53:58 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954 1073741824" returned: 0 in 1.326s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:53:58 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954
Sep 30 17:53:58 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:53:58 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954" returned: 0 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efdf500-784b-44f1-b167-ee49a5317275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3971122-a7e9-4f8a-8465-4c5495456954', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d1b7d5-4fbb-4406-bd3f-dc8f2cd4a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:53:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Volume volume-a3971122-a7e9-4f8a-8465-4c5495456954 (a3971122-a7e9-4f8a-8465-4c5495456954): created successfully
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d1b7d5-4fbb-4406-bd3f-dc8f2cd4a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:53:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Flow 'volume_create_manager' (1e19a5ee-d2d6-443c-beca-71c12ed1eb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:53:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-72e37343-d6ba-4c3b-b671-cf940d957023 tempest-ServerRescueNegativeTestJSON-1665540813 None] Created volume successfully.
Sep 30 17:53:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1bf767c1-bf50-4aa5-8d2d-a3dabef2b051 req-34bdc7d7-1008-482b-af72-84642a0087de tempest-TaggedAttachmentsTest-1247537616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:53:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1bf767c1-bf50-4aa5-8d2d-a3dabef2b051 req-34bdc7d7-1008-482b-af72-84642a0087de tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:53:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1bf767c1-bf50-4aa5-8d2d-a3dabef2b051 req-34bdc7d7-1008-482b-af72-84642a0087de tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:53:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1bf767c1-bf50-4aa5-8d2d-a3dabef2b051 req-34bdc7d7-1008-482b-af72-84642a0087de tempest-TaggedAttachmentsTest-1247537616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-6f702a19-389e-49c4-9af9-7ce21098612b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '576854e5-f258-44f3-8881-6889459de007', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:53:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-1bf767c1-bf50-4aa5-8d2d-a3dabef2b051 req-34bdc7d7-1008-482b-af72-84642a0087de tempest-TaggedAttachmentsTest-1247537616 None] attachment_update completed successfully.
Sep 30 17:54:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-0a99c600-cbbf-4956-9577-b9611678ae59 req-1def008a-f94d-446b-8015-6289b4de41b1 tempest-TaggedAttachmentsTest-1247537616 None] Terminate volume connection completed successfully.
Sep 30 17:54:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-0a99c600-cbbf-4956-9577-b9611678ae59 req-1def008a-f94d-446b-8015-6289b4de41b1 tempest-TaggedAttachmentsTest-1247537616 None] Deleting attachment 576854e5-f258-44f3-8881-6889459de007. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Flow 'volume_create_manager' (0959e38d-675a-4e4f-b919-9c5678b2ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d239c966-926a-4f9e-bae7-518a357e4fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d239c966-926a-4f9e-bae7-518a357e4fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-764271324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2736865-4d16-4de8-b324-a0617300b95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e304b00811c042fda28cfeef4223ce1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:54:11Z,use_quota=True,user_id='4ff5154df74b4b5cbd60f2bc53f7314e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa00dbb8-6860-44e5-b7fc-0fdaa0bfcfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa00dbb8-6860-44e5-b7fc-0fdaa0bfcfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10732ab9-7efe-4405-ac93-7d8a748e006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10732ab9-7efe-4405-ac93-7d8a748e006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2736865-4d16-4de8-b324-a0617300b95d', 'volume_name': 'volume-e2736865-4d16-4de8-b324-a0617300b95d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe443c8-8c87-4529-a6ea-26b37f631d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe443c8-8c87-4529-a6ea-26b37f631d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adaf2f0-c218-44d6-98f5-d533a27918b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:10 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Volume e2736865-4d16-4de8-b324-a0617300b95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2736865-4d16-4de8-b324-a0617300b95d', 'volume_size': 1}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-764271324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2736865-4d16-4de8-b324-a0617300b95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e304b00811c042fda28cfeef4223ce1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:54:11Z,use_quota=True,user_id='4ff5154df74b4b5cbd60f2bc53f7314e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Creating volume e2736865-4d16-4de8-b324-a0617300b95d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:54:10 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:54:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:10 devstack sudo[91041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d 1073741824
Sep 30 17:54:10 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:11 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d 1073741824" returned: 0 in 1.001s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:12 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d
Sep 30 17:54:12 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:12 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d" returned: 0 in 0.532s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adaf2f0-c218-44d6-98f5-d533a27918b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2736865-4d16-4de8-b324-a0617300b95d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e823a1-a6da-41e8-bb8a-d9900c38c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:12 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Volume volume-e2736865-4d16-4de8-b324-a0617300b95d (e2736865-4d16-4de8-b324-a0617300b95d): created successfully
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e823a1-a6da-41e8-bb8a-d9900c38c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Flow 'volume_create_manager' (0959e38d-675a-4e4f-b919-9c5678b2ba19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:54:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d6b989a2-78ac-4df9-b8ed-d02338a276e2 tempest-AttachVolumeShelveTestJSON-1238697253 None] Created volume successfully.
Sep 30 17:54:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Acquiring lock "cinder-a3971122-a7e9-4f8a-8465-4c5495456954-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:54:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "cinder-a3971122-a7e9-4f8a-8465-4c5495456954-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:54:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Acquiring lock "cinder-quobyte-a3971122-a7e9-4f8a-8465-4c5495456954" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:54:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "cinder-quobyte-a3971122-a7e9-4f8a-8465-4c5495456954" acquired by "delete_volume" :: waited 0.051s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:54:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6501a-557c-4afd-8321-ed4912f660b5]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:54:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:16 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954
Sep 30 17:54:16 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:17 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954" returned: 0 in 1.127s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:17 devstack sudo[91141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954
Sep 30 17:54:17 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a3971122-a7e9-4f8a-8465-4c5495456954" returned: 0 in 0.480s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:17 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "cinder-quobyte-a3971122-a7e9-4f8a-8465-4c5495456954" released by "delete_volume" :: held 1.753s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Created reservations ['3e4f16a3-811a-441f-81aa-240b5bb4f589', '8c41b6f2-d71d-4628-a3bf-a5759780d73d', 'b3f7b076-dd72-494f-91ce-3c8c2eef8fe3', '9552326b-f587-435c-adb4-81c835fedaa4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:18 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:54:18 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:18 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.486s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:54:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Deleted volume successfully.
Sep 30 17:54:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9959363c-5957-44d7-87f8-da27a516aff7 tempest-ServerRescueNegativeTestJSON-1665540813 None] Lock "cinder-a3971122-a7e9-4f8a-8465-4c5495456954-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:54:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Acquiring lock "cinder-6f702a19-389e-49c4-9af9-7ce21098612b-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:54:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Lock "cinder-6f702a19-389e-49c4-9af9-7ce21098612b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:54:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Acquiring lock "cinder-quobyte-6f702a19-389e-49c4-9af9-7ce21098612b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:54:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Lock "cinder-quobyte-6f702a19-389e-49c4-9af9-7ce21098612b" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:54:24 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[64912417-b722-4ff3-adec-5b104bba5bfb]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:54:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:24 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b
Sep 30 17:54:24 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:25 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b" returned: 0 in 0.726s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:25 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b
Sep 30 17:54:25 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:25 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6f702a19-389e-49c4-9af9-7ce21098612b" returned: 0 in 0.402s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Lock "cinder-quobyte-6f702a19-389e-49c4-9af9-7ce21098612b" released by "delete_volume" :: held 1.248s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:54:25 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Created reservations ['73aa7b49-30a7-4845-8a01-629decbd9933', '4d18e7dc-0be5-4de0-a67e-0406eb0f98ed', 'e3c9ed4c-2546-4f6c-8203-19927a2643bc', '11b3fe30-5b8c-4efd-8fc1-2149823d1d60'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:26 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:54:26 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:26 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.433s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:54:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Deleted volume successfully.
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fbd9950d-5caf-49e0-a229-5550c937570f tempest-TaggedAttachmentsTest-1247537616 None] Lock "cinder-6f702a19-389e-49c4-9af9-7ce21098612b-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-fd6ee375-8f24-482c-b602-cd411736b183 req-34a9f540-daf2-4305-b927-8feee23ad696 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-fd6ee375-8f24-482c-b602-cd411736b183 req-34a9f540-daf2-4305-b927-8feee23ad696 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-fd6ee375-8f24-482c-b602-cd411736b183 req-34a9f540-daf2-4305-b927-8feee23ad696 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-fd6ee375-8f24-482c-b602-cd411736b183 req-34a9f540-daf2-4305-b927-8feee23ad696 tempest-ServerActionsTestOtherA-1846242258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-84f1c370-47e0-4146-8312-be0dc54c802b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32c12728-eed1-406a-8fbf-026690f56499', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:54:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-fd6ee375-8f24-482c-b602-cd411736b183 req-34a9f540-daf2-4305-b927-8feee23ad696 tempest-ServerActionsTestOtherA-1846242258 None] attachment_update completed successfully.
Sep 30 17:54:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-ea8080b4-2b28-41ab-8abf-8df945027bdf req-052e6f71-9a0c-4864-9dc0-192663166ad9 tempest-AttachVolumeShelveTestJSON-1238697253 None] No connector for attachment 6c529abc-c362-4a96-b0a2-c4c9fb86b28c; skipping storage backend terminate_connection call. {{(pid=87418) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 30 17:54:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-ea8080b4-2b28-41ab-8abf-8df945027bdf req-052e6f71-9a0c-4864-9dc0-192663166ad9 tempest-AttachVolumeShelveTestJSON-1238697253 None] Deleting attachment 6c529abc-c362-4a96-b0a2-c4c9fb86b28c. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:54:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-7a173880-b411-450d-95f7-de6408279932 req-127b4d9c-7857-4385-9cbb-c86878e31988 tempest-ServerActionsTestOtherA-1846242258 None] Terminate volume connection completed successfully.
Sep 30 17:54:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-7a173880-b411-450d-95f7-de6408279932 req-127b4d9c-7857-4385-9cbb-c86878e31988 tempest-ServerActionsTestOtherA-1846242258 None] Deleting attachment 32c12728-eed1-406a-8fbf-026690f56499. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:54:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7a173880-b411-450d-95f7-de6408279932 req-7c99a47a-e0b2-435b-8bb6-a206ab7aa1a5 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7a173880-b411-450d-95f7-de6408279932 req-7c99a47a-e0b2-435b-8bb6-a206ab7aa1a5 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7a173880-b411-450d-95f7-de6408279932 req-7c99a47a-e0b2-435b-8bb6-a206ab7aa1a5 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-7a173880-b411-450d-95f7-de6408279932 req-7c99a47a-e0b2-435b-8bb6-a206ab7aa1a5 tempest-ServerActionsTestOtherA-1846242258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-84f1c370-47e0-4146-8312-be0dc54c802b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a87af0b4-52aa-4301-9280-fc26debcae7b', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:54:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-7a173880-b411-450d-95f7-de6408279932 req-7c99a47a-e0b2-435b-8bb6-a206ab7aa1a5 tempest-ServerActionsTestOtherA-1846242258 None] attachment_update completed successfully.
Sep 30 17:54:43 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=38,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:46 devstack sudo[92346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:54:46 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:47 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.672s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:54:47 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:54:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 8 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:54:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=27,cinder:SELECT=36,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Flow 'volume_create_manager' (770e8376-9dd3-47c7-ad96-0aaee7b1f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc11fa27-319e-4cfa-aba2-2ee1c8dda46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc11fa27-319e-4cfa-aba2-2ee1c8dda46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-601624124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b8aad-4d7b-41bb-8c88-a43c56f53c7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f759685045af4067899b30475a92d164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:54:50Z,use_quota=True,user_id='1ff7708f3c6d4ca1a45a0bc8e9e32d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e16aa-dad4-4cf0-b05c-42ae7d7a7ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e16aa-dad4-4cf0-b05c-42ae7d7a7ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d2683c-2dc0-463c-b66e-dcd2c0dab5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d2683c-2dc0-463c-b66e-dcd2c0dab5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06b8aad-4d7b-41bb-8c88-a43c56f53c7a', 'volume_name': 'volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c24e25-b851-41b4-a50d-9c0a9ad23288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c24e25-b851-41b4-a50d-9c0a9ad23288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407ab438-d648-4ff5-90b8-bc9f8f817ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:49 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Volume d06b8aad-4d7b-41bb-8c88-a43c56f53c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a', 'volume_size': 1}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-601624124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b8aad-4d7b-41bb-8c88-a43c56f53c7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f759685045af4067899b30475a92d164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:54:50Z,use_quota=True,user_id='1ff7708f3c6d4ca1a45a0bc8e9e32d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Creating volume d06b8aad-4d7b-41bb-8c88-a43c56f53c7a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:54:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:54:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:54:50 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:54:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:50 devstack sudo[92383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a 1073741824
Sep 30 17:54:50 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:50 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a 1073741824" returned: 0 in 0.933s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:51 devstack sudo[92451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a
Sep 30 17:54:51 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:51 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a" returned: 0 in 0.314s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407ab438-d648-4ff5-90b8-bc9f8f817ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7df8b6e-4c00-4d25-b9f4-1d837ecba8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:54:51 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Volume volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a (d06b8aad-4d7b-41bb-8c88-a43c56f53c7a): created successfully
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7df8b6e-4c00-4d25-b9f4-1d837ecba8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:54:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Flow 'volume_create_manager' (770e8376-9dd3-47c7-ad96-0aaee7b1f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:54:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-8a6e3b35-b3fc-4b69-ad5d-b8fe77154f27 req-7edb3239-4849-42e5-a867-8fc6f9e0ba47 tempest-VolumesGetTestJSON-807966279 None] Created volume successfully.
Sep 30 17:54:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Acquiring lock "cinder-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:54:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Lock "cinder-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:54:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Acquiring lock "cinder-quobyte-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:54:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Lock "cinder-quobyte-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a" acquired by "delete_volume" :: waited 0.048s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:54:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[374adc79-9477-44d5-a377-1f8ff0daad0e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:54:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:52 devstack sudo[92475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a
Sep 30 17:54:52 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:53 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a" returned: 0 in 0.613s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:53 devstack sudo[92481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a
Sep 30 17:54:53 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:53 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a" returned: 0 in 0.316s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Lock "cinder-quobyte-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a" released by "delete_volume" :: held 1.032s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG cinder.quota [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Created reservations ['d38eebc3-9648-4f5a-9d16-b32e680f93a0', '57d768b6-6101-45e5-ab6f-b847f4c9107c', '39e01e72-b704-4bd8-9bc5-9c6ff8ea8018', '496a0f91-5c5a-40e6-84d2-52a9c9f0f568'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:54:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:54:53 devstack sudo[92484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:54:53 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:54:54 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root
Sep 30 17:54:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.283s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:54:54 devstack cinder-volume[87418]: DEBUG cinder.manager [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:54:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Deleted volume successfully.
Sep 30 17:54:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-f3ca6546-faad-4f3e-a4bb-60db38670782 req-a9735976-eb71-41b2-817a-af6e5c3024d5 tempest-VolumesGetTestJSON-807966279 None] Lock "cinder-d06b8aad-4d7b-41bb-8c88-a43c56f53c7a-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:03 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:55:04 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:55:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-f20c5af7-26ad-45aa-93dd-a514cb585554 req-5d7fb3d2-1ba1-4cdd-847e-9833233cb0bf tempest-ServerActionsTestOtherA-1846242258 None] Terminate volume connection completed successfully.
Sep 30 17:55:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-f20c5af7-26ad-45aa-93dd-a514cb585554 req-5d7fb3d2-1ba1-4cdd-847e-9833233cb0bf tempest-ServerActionsTestOtherA-1846242258 None] Deleting attachment a87af0b4-52aa-4301-9280-fc26debcae7b. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Flow 'volume_create_manager' (f446d808-afc5-4f93-bdbb-1628c67fa778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885da68e-638d-49ec-a8b2-909791a26a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885da68e-638d-49ec-a8b2-909791a26a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1191924011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca0fe587cf4e5f908f10b500be7e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:12Z,use_quota=True,user_id='fdb244f08c794755883d594ad737fb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebed164-8b1a-4900-b194-8c7166d5cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebed164-8b1a-4900-b194-8c7166d5cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04532423-59de-4b39-93f4-da04a92f3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:11 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 17:55:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04532423-59de-4b39-93f4-da04a92f3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c', 'volume_name': 'volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c149dda7b0>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c166a1-69aa-42a5-8288-10a4543d298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c166a1-69aa-42a5-8288-10a4543d298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fee1445-4e24-45aa-9a9d-4179cea05efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:12 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Volume a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c149dda7b0>}
Sep 30 17:55:12 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Trying to clone a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c from image 90139efc-54c0-4670-ab72-2da0af285eb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 17:55:13 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ee2a56-78c5-435c-a9f0-f0ad04a80529]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:13 devstack sudo[93028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD
Sep 30 17:55:13 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:13 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 is fetched for user fdb244f08c794755883d594ad737fb48. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db9aa5-d5c1-451c-89df-260817395915]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:14 devstack sudo[93033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD
Sep 30 17:55:14 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:14 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1191924011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca0fe587cf4e5f908f10b500be7e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:12Z,use_quota=True,user_id='fdb244f08c794755883d594ad737fb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Creating volume a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:55:14 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:14 devstack sudo[93041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c 1073741824
Sep 30 17:55:14 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:14 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c 1073741824" returned: 0 in 0.672s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:15 devstack sudo[93138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c
Sep 30 17:55:15 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:15 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" returned: 0 in 0.520s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Attempting download of 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d086a-ca25-46f2-8e8b-9aea5a3f77da]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:15 devstack sudo[93163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig
Sep 30 17:55:15 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:16 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig" returned: 0 in 0.636s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:16 devstack sudo[93167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig
Sep 30 17:55:16 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:16 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig" returned: 1 in 0.613s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_nplh38ig' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 17:55:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd8d35-ec00-4ab8-b1bc-725df5e7fc23]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:17 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD
Sep 30 17:55:17 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:17 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:17 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] 90139efc-54c0-4670-ab72-2da0af285eb6 was qcow2, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 17:55:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:17 devstack sudo[93180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c
Sep 30 17:55:17 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Flow 'volume_create_manager' (82a93ec6-bcdb-46d1-bb69-23d248989e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f6b544-c40a-40c1-8050-93b0859a5186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f6b544-c40a-40c1-8050-93b0859a5186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-655795551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c9022a46884120b7f881c78a954948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:18Z,use_quota=True,user_id='6475cb4681f44ff2842e06759ceb9db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1216d601-23af-431d-b22b-b0cefc33ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1216d601-23af-431d-b22b-b0cefc33ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d68b74-cca2-4bc6-a427-92ad5918c251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d68b74-cca2-4bc6-a427-92ad5918c251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4', 'volume_name': 'volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a013ef96-a746-4c1e-af2a-f2b4b149b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a013ef96-a746-4c1e-af2a-f2b4b149b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db4563b-8cb2-4f5d-8ccc-dcfd78282b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:18 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Volume 5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4', 'volume_size': 1}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-655795551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c9022a46884120b7f881c78a954948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:18Z,use_quota=True,user_id='6475cb4681f44ff2842e06759ceb9db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Creating volume 5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:55:18 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:55:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:18 devstack sudo[93207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 1073741824
Sep 30 17:55:18 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:19 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 1073741824" returned: 0 in 0.499s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:19 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4
Sep 30 17:55:19 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:19 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4" returned: 0 in 0.337s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db4563b-8cb2-4f5d-8ccc-dcfd78282b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd003cc-ad74-47fa-9c0a-4cc5bc619a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:19 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Volume volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 (5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4): created successfully
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd003cc-ad74-47fa-9c0a-4cc5bc619a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Flow 'volume_create_manager' (82a93ec6-bcdb-46d1-bb69-23d248989e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9a3ecc20-a178-48db-bac2-6cc47e455139 tempest-VolumeQuotasNegativeTestJSON-712414490 None] Created volume successfully.
Sep 30 17:55:19 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" returned: 0 in 2.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_qghxexzedevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 17:55:19 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Converted 112.00 MB image at 49.41 MB/s
Sep 30 17:55:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:19 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c 1G
Sep 30 17:55:19 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Acquiring lock "cinder-e2736865-4d16-4de8-b324-a0617300b95d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "cinder-e2736865-4d16-4de8-b324-a0617300b95d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:55:20 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Acquiring lock "cinder-quobyte-e2736865-4d16-4de8-b324-a0617300b95d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c 1G" returned: 0 in 0.342s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Downloaded image 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 for user fdb244f08c794755883d594ad737fb48 is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Marking volume a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "cinder-quobyte-e2736865-4d16-4de8-b324-a0617300b95d" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Copying metadata from image 90139efc-54c0-4670-ab72-2da0af285eb6 to a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Creating volume glance metadata for volume a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c backed by image 90139efc-54c0-4670-ab72-2da0af285eb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50e383-c20d-4bb8-b8bb-35603f8ced9d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fee1445-4e24-45aa-9a9d-4179cea05efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c149dda7b0>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a979c1a-bdaf-4d91-aa5a-6699b4e4512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Volume volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c (a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c): created successfully
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a979c1a-bdaf-4d91-aa5a-6699b4e4512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Flow 'volume_create_manager' (f446d808-afc5-4f93-bdbb-1628c67fa778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:20 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d
Sep 30 17:55:20 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-98f6a522-57fc-4886-a5ae-f2e41757adaf tempest-ServerActionsTestOtherA-1846242258 None] Created volume successfully.
Sep 30 17:55:20 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d" returned: 0 in 0.348s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:20 devstack sudo[93226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d
Sep 30 17:55:20 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:20 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2736865-4d16-4de8-b324-a0617300b95d" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "cinder-quobyte-e2736865-4d16-4de8-b324-a0617300b95d" released by "delete_volume" :: held 0.687s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Created reservations ['527a7c2a-0d8d-4413-9dd9-8479fa3472d5', 'f6d70d58-1a04-4499-bba4-74186334fb82', 'd7f9571d-1380-44fc-9157-e978690be480', '809f666e-60b8-4f60-8761-8415da4f4674'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:21 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:55:21 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:21 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:55:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Deleted volume successfully.
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7288c6d1-43d2-4c1a-9f4a-def990f127b6 tempest-AttachVolumeShelveTestJSON-1238697253 None] Lock "cinder-e2736865-4d16-4de8-b324-a0617300b95d-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Acquiring lock "cinder-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "cinder-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Acquiring lock "cinder-quobyte-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "cinder-quobyte-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2745f4e3-cec9-411f-b43e-373bf6cbe603]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:21 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4
Sep 30 17:55:21 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:22 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4" returned: 0 in 0.439s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:22 devstack sudo[93240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4
Sep 30 17:55:22 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:22 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "cinder-quobyte-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4" released by "delete_volume" :: held 0.758s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Created reservations ['6b630617-faf3-4b4a-a297-c8be59d64ed4', '9cf61a5f-0f4e-4c3c-846f-a5d8413bdf55', 'ca56838d-a5a5-4602-9dc3-5e6f505afb62', '95acbba3-60ff-42d0-b60c-a0cee85dc126'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:22 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:55:22 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:23 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.469s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:55:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Deleted volume successfully.
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9eae946f-8e85-4ccd-ae57-45c957aff2ba tempest-VolumeQuotasNegativeTestJSON-712414490 None] Lock "cinder-5c05e9ce-6328-40d4-ba9b-2f2b3446dcf4-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-f413e3f2-3e21-4f66-a0f2-fe2a33443353 req-c76dcac1-5f88-4fe0-9c5d-d601d9857702 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-f413e3f2-3e21-4f66-a0f2-fe2a33443353 req-c76dcac1-5f88-4fe0-9c5d-d601d9857702 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-f413e3f2-3e21-4f66-a0f2-fe2a33443353 req-c76dcac1-5f88-4fe0-9c5d-d601d9857702 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-f413e3f2-3e21-4f66-a0f2-fe2a33443353 req-c76dcac1-5f88-4fe0-9c5d-d601d9857702 tempest-ServerActionsTestOtherA-1846242258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30ba18f1-db0e-4585-90a5-9de7f803fafd', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:55:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-f413e3f2-3e21-4f66-a0f2-fe2a33443353 req-c76dcac1-5f88-4fe0-9c5d-d601d9857702 tempest-ServerActionsTestOtherA-1846242258 None] attachment_update completed successfully.
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Flow 'volume_create_manager' (0c68afa1-16a7-414b-a2ef-84aefc530d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fef2738-32eb-49e6-b7e8-39392a8331d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fef2738-32eb-49e6-b7e8-39392a8331d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1309305595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbd416c-18e8-4875-9133-f81fef011029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e810dc290d264d2fbff670d69f2cf308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:29Z,use_quota=True,user_id='4260ee07e2a64883bc56f25d0fde1230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27991e08-a4f0-431a-b505-a4bce225b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27991e08-a4f0-431a-b505-a4bce225b316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924460fb-8bf2-482a-a603-5b0f2700a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924460fb-8bf2-482a-a603-5b0f2700a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbd416c-18e8-4875-9133-f81fef011029', 'volume_name': 'volume-5dbd416c-18e8-4875-9133-f81fef011029', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f473196-7c4b-45c0-8096-2963100ace52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f473196-7c4b-45c0-8096-2963100ace52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bb3f4f-d8a5-40ba-8724-14f2703cdc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:29 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Volume 5dbd416c-18e8-4875-9133-f81fef011029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbd416c-18e8-4875-9133-f81fef011029', 'volume_size': 1}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1309305595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbd416c-18e8-4875-9133-f81fef011029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e810dc290d264d2fbff670d69f2cf308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:29Z,use_quota=True,user_id='4260ee07e2a64883bc56f25d0fde1230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Creating volume 5dbd416c-18e8-4875-9133-f81fef011029 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:55:29 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:55:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:29 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029 1073741824
Sep 30 17:55:29 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:29 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029 1073741824" returned: 0 in 0.568s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:30 devstack sudo[93737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029
Sep 30 17:55:30 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:30 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bb3f4f-d8a5-40ba-8724-14f2703cdc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbd416c-18e8-4875-9133-f81fef011029', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fe938f-d6fb-4d9a-8bbc-57b7f47a87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:30 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Volume volume-5dbd416c-18e8-4875-9133-f81fef011029 (5dbd416c-18e8-4875-9133-f81fef011029): created successfully
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fe938f-d6fb-4d9a-8bbc-57b7f47a87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Flow 'volume_create_manager' (0c68afa1-16a7-414b-a2ef-84aefc530d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2dcd9cf1-df41-4616-8711-0b4db33cf468 tempest-AttachVolumeNegativeTest-914970347 None] Created volume successfully.
Sep 30 17:55:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-d94d2d2a-d6e6-4468-8649-881b76fc14f8 req-f0026641-0194-401d-b0a1-aa06166d38ee tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-d94d2d2a-d6e6-4468-8649-881b76fc14f8 req-f0026641-0194-401d-b0a1-aa06166d38ee tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-d94d2d2a-d6e6-4468-8649-881b76fc14f8 req-f0026641-0194-401d-b0a1-aa06166d38ee tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-d94d2d2a-d6e6-4468-8649-881b76fc14f8 req-f0026641-0194-401d-b0a1-aa06166d38ee tempest-AttachVolumeNegativeTest-914970347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-5dbd416c-18e8-4875-9133-f81fef011029', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b85ccdf6-f183-425d-8248-3d899b43c8f6', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:55:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-d94d2d2a-d6e6-4468-8649-881b76fc14f8 req-f0026641-0194-401d-b0a1-aa06166d38ee tempest-AttachVolumeNegativeTest-914970347 None] attachment_update completed successfully.
Sep 30 17:55:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-4b2b207f-aae3-47fc-b91d-df4cef6be410 tempest-BackendsCapabilitiesAdminTestsJSON-887709836 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9045333862305, 'free_capacity_gb': 1774.9045333862305, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87418) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 30 17:55:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b389c32e-8ca3-457c-8077-4d69f51df248 tempest-BackendsCapabilitiesAdminTestsJSON-887709836 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9045333862305, 'free_capacity_gb': 1774.9045333862305, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87418) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 30 17:55:42 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=40,cinder:UPDATE=26,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:55:42 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=35,cinder:INSERT=14,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:55:45 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-ba6f1079-00a6-4027-b160-5cc3d843f25f tempest-ServerActionsTestOtherA-1846242258 None] Terminate volume connection completed successfully.
Sep 30 17:55:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-ba6f1079-00a6-4027-b160-5cc3d843f25f tempest-ServerActionsTestOtherA-1846242258 None] Deleting attachment 30ba18f1-db0e-4585-90a5-9de7f803fafd. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:46 devstack sudo[93881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:55:46 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:46 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Flow 'volume_create_manager' (4bfac50f-e681-484d-86cb-04c84e2e3084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ebe50b-9cef-45ba-ba27-331cb81a4fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.586s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ebe50b-9cef-45ba-ba27-331cb81a4fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-163119563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098a0d2c38f9499e9e18a1b697e646b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:47Z,use_quota=True,user_id='103dd693eca3431cb7ee8379c902677d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b810db87-26be-46c6-83e0-dcc180d55c31),volume_type_id=b810db87-26be-46c6-83e0-dcc180d55c31)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972f5815-2fbb-43ba-9fe5-deca94cda973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972f5815-2fbb-43ba-9fe5-deca94cda973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0197c6fc-62dc-4346-87bc-06a71acaa24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0197c6fc-62dc-4346-87bc-06a71acaa24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25', 'volume_name': 'volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7debe5fe-219e-4a8d-9e24-a5f02856fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7debe5fe-219e-4a8d-9e24-a5f02856fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67066e81-882b-469d-80ef-b296c82c8054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:47 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Volume ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25', 'volume_size': 1}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-163119563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098a0d2c38f9499e9e18a1b697e646b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:47Z,use_quota=True,user_id='103dd693eca3431cb7ee8379c902677d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b810db87-26be-46c6-83e0-dcc180d55c31),volume_type_id=b810db87-26be-46c6-83e0-dcc180d55c31)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Creating volume ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:55:47 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:47 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 1073741824
Sep 30 17:55:47 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-84d2d9ac-818e-44df-817f-6e08dea84777 tempest-GroupSnapshotsTest-483800652 None] Group tempest-GroupSnapshotsTest-Group-2115680184: creating
Sep 30 17:55:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-84d2d9ac-818e-44df-817f-6e08dea84777 tempest-GroupSnapshotsTest-483800652 None] Group tempest-GroupSnapshotsTest-Group-2115680184: created successfully
Sep 30 17:55:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-84d2d9ac-818e-44df-817f-6e08dea84777 tempest-GroupSnapshotsTest-483800652 None] Create group completed successfully.
Sep 30 17:55:47 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 1073741824" returned: 0 in 0.546s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:47 devstack sudo[93916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25
Sep 30 17:55:47 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-00ce05c2-139b-4b7f-ad22-d97086b2d0df tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:47 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-00ce05c2-139b-4b7f-ad22-d97086b2d0df tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67066e81-882b-469d-80ef-b296c82c8054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3f611a-82c9-40d1-a1f9-0540570d6685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-00ce05c2-139b-4b7f-ad22-d97086b2d0df tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:47 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Volume volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 (ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25): created successfully
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3f611a-82c9-40d1-a1f9-0540570d6685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Flow 'volume_create_manager' (4bfac50f-e681-484d-86cb-04c84e2e3084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0187fb43-5f31-4e1e-b7b8-99e89da881ed tempest-VolumeTypesAccessTest-995717355 None] Created volume successfully.
Sep 30 17:55:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-00ce05c2-139b-4b7f-ad22-d97086b2d0df tempest-ServerActionsTestOtherA-1846242258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b173f8b4-6d86-4dc6-b638-d9cc38ba9956', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:55:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-b3ab1f3a-2cf2-460f-8c9a-e847bd8a4c5b req-00ce05c2-139b-4b7f-ad22-d97086b2d0df tempest-ServerActionsTestOtherA-1846242258 None] attachment_update completed successfully.
Sep 30 17:55:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Acquiring lock "cinder-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Lock "cinder-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Acquiring lock "cinder-quobyte-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Lock "cinder-quobyte-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dbe86e-4904-4442-be67-c8d893b77681]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (4e2ad1cc-7ca3-4adc-a3e5-7c056b5793e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a878892d-a67f-4725-a0e9-a0a1d80ffa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a878892d-a67f-4725-a0e9-a0a1d80ffa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1825388820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cdecdfd4-57a3-4820-b165-698aaf16820f,host='devstack@QuobyteHD#QuobyteHD',id=7a0a88db-503b-4f24-9daa-c2f29940dbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:49Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a4a213a-c023-4178-8ad7-8b8df5b53da4),volume_type_id=7a4a213a-c023-4178-8ad7-8b8df5b53da4)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7cd8d2-8601-4139-897b-498b55154078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7cd8d2-8601-4139-897b-498b55154078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a5aff9-c1ec-4f77-b70d-c3097a356258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a5aff9-c1ec-4f77-b70d-c3097a356258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0a88db-503b-4f24-9daa-c2f29940dbba', 'volume_name': 'volume-7a0a88db-503b-4f24-9daa-c2f29940dbba', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:49 devstack sudo[93950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25
Sep 30 17:55:49 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35eda4c-39ca-423f-9b81-5e547bc19ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35eda4c-39ca-423f-9b81-5e547bc19ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66378a3-1b7b-40a9-817a-4dbf827fc225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:49 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Volume 7a0a88db-503b-4f24-9daa-c2f29940dbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0a88db-503b-4f24-9daa-c2f29940dbba', 'volume_size': 1}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cdecdfd4-57a3-4820-b165-698aaf16820f,created_at=2026-09-30T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1825388820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cdecdfd4-57a3-4820-b165-698aaf16820f,host='devstack@QuobyteHD#QuobyteHD',id=7a0a88db-503b-4f24-9daa-c2f29940dbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:55:49Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a4a213a-c023-4178-8ad7-8b8df5b53da4),volume_type_id=7a4a213a-c023-4178-8ad7-8b8df5b53da4)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Creating volume 7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:55:49 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:49 devstack sudo[93956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba 1073741824
Sep 30 17:55:49 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:49 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25" returned: 0 in 0.581s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:49 devstack sudo[93966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25
Sep 30 17:55:49 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:50 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Lock "cinder-quobyte-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25" released by "delete_volume" :: held 1.017s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:50 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:50 devstack cinder-volume[87418]: WARNING cinder.quota [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-132857614 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-132857614, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:55:50 devstack cinder-volume[87418]: WARNING cinder.quota [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-132857614 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-132857614, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba 1073741824" returned: 0 in 0.786s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Created reservations ['a79f5c87-1abd-4c1c-a553-481a08298e6d', '9c14bfc5-1c26-4b0b-9b74-0c8b2b322d74', '18edb86b-2ac8-4ee7-8886-365ecf0dcc27', '55197389-06ab-46ec-a4ee-df024beb71e8'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:50 devstack sudo[93983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba
Sep 30 17:55:50 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:50 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:55:50 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:50 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba" returned: 0 in 0.606s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66378a3-1b7b-40a9-817a-4dbf827fc225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0a88db-503b-4f24-9daa-c2f29940dbba', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bd9b3b-d9dc-4c6d-930a-623cd3bf7727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:55:50 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.574s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:50 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:55:51 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Volume volume-7a0a88db-503b-4f24-9daa-c2f29940dbba (7a0a88db-503b-4f24-9daa-c2f29940dbba): created successfully
Sep 30 17:55:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bd9b3b-d9dc-4c6d-930a-623cd3bf7727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:55:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (4e2ad1cc-7ca3-4adc-a3e5-7c056b5793e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:55:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Deleted volume successfully.
Sep 30 17:55:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1145b22e-edcc-4da1-93ae-2389965c5cae tempest-GroupSnapshotsTest-483800652 None] Created volume successfully.
Sep 30 17:55:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0023e0d9-978a-4ad6-8b25-8053af500b80 tempest-VolumeTypesAccessTest-995717355 None] Lock "cinder-ad0b0f27-b5ab-4532-80ec-d6c2f88e1a25-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:55:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] GroupSnapshot 23510bad-eb65-4b3c-bfb5-04c1fcbd5f75: creating.
Sep 30 17:55:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Group snapshot 23510bad-eb65-4b3c-bfb5-04c1fcbd5f75: creating. {{(pid=87418) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 30 17:55:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:55:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:55:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Creating offline snapshot 45fc1c27-cf7e-41af-a798-a82708742d94 of volume 7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:55:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e416d5-f618-405a-8722-2cbf5464a395]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:55:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:53 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba
Sep 30 17:55:53 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:53 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba" returned: 0 in 0.715s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:53 devstack sudo[94068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 1G
Sep 30 17:55:53 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:54 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 1G" returned: 0 in 1.241s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0a88db-503b-4f24-9daa-c2f29940dbba -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:54 devstack sudo[94074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0a88db-503b-4f24-9daa-c2f29940dbba -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94
Sep 30 17:55:54 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:55 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0a88db-503b-4f24-9daa-c2f29940dbba -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94" returned: 0 in 0.665s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:55 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:55:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:55 devstack sudo[94080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94
Sep 30 17:55:55 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:56 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94" returned: 0 in 0.527s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:56 devstack sudo[94083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info
Sep 30 17:55:56 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:56 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info" returned: 0 in 0.398s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:56 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:55:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:55:56 devstack sudo[94086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info
Sep 30 17:55:56 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:55:57 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root
Sep 30 17:55:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.info" returned: 0 in 0.555s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:55:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:55:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-31cd4f11-1f3f-4983-a0c7-4cdeb0343279 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 23510bad-eb65-4b3c-bfb5-04c1fcbd5f75: created successfully
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-45fc1c27-cf7e-41af-a798-a82708742d94-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-45fc1c27-cf7e-41af-a798-a82708742d94-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Creating volume bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f from snapshot 45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] snapshot: 45fc1c27-cf7e-41af-a798-a82708742d94, volume: bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d8236-2848-493e-936d-0fd4d071d043]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:00 devstack sudo[94091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94
Sep 30 17:56:00 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:01 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94" returned: 0 in 0.678s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a0a88db-503b-4f24-9daa-c2f29940dbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96894870-9de3-4532-beb5-0f25fba16f4d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:01 devstack sudo[94097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba
Sep 30 17:56:01 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:01 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba" returned: 0 in 0.586s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 17:56:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:01 devstack sudo[94103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f
Sep 30 17:56:01 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:10 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=31,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:56:10 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:56:12 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" returned: 0 in 10.432s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba, size 1024.00 MB, duration 10.43 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 17:56:12 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Converted 1024.00 MB image at 98.15 MB/s
Sep 30 17:56:12 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:12 devstack sudo[94162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f
Sep 30 17:56:12 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:12 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" released by "_copy_volume_from_snapshot" :: held 12.210s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-45fc1c27-cf7e-41af-a798-a82708742d94-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" released by "_create_volume_from_snapshot" :: held 12.331s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.379s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ad13a6a1-f3fd-4a0b-b982-41f5e632f0b8 tempest-GroupSnapshotsTest-483800652 None] Create group from source-snapshot-23510bad-eb65-4b3c-bfb5-04c1fcbd5f75 completed successfully.
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Flow 'volume_create_manager' (452c18b4-b184-4666-a13a-bad71efbedab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1085df8f-7903-43e4-996f-f0a175fa81d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1085df8f-7903-43e4-996f-f0a175fa81d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1182775187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c50c7c-a880-4016-aeb2-6ce14af8b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4463c3b531144abc979d675fc7abb5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:13Z,use_quota=True,user_id='6430ebf24e324731b24e58936df7312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c703aad-8e8a-4636-a9f0-4984c5fd3329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c703aad-8e8a-4636-a9f0-4984c5fd3329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46dd1a5a-b440-49f5-a08a-c1cb7e93bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46dd1a5a-b440-49f5-a08a-c1cb7e93bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c50c7c-a880-4016-aeb2-6ce14af8b691', 'volume_name': 'volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697b9f01-54f8-4ef0-8b35-d3dc40817ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697b9f01-54f8-4ef0-8b35-d3dc40817ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8419fd-5cba-4021-af15-4e337c698c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:13 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Volume c1c50c7c-a880-4016-aeb2-6ce14af8b691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691', 'volume_size': 1}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1182775187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c50c7c-a880-4016-aeb2-6ce14af8b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4463c3b531144abc979d675fc7abb5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:13Z,use_quota=True,user_id='6430ebf24e324731b24e58936df7312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Creating volume c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:13 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:13 devstack sudo[94165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 1073741824
Sep 30 17:56:13 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:13 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 1073741824" returned: 0 in 0.397s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:13 devstack sudo[94170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691
Sep 30 17:56:13 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:14 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8419fd-5cba-4021-af15-4e337c698c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dbf2b7-4506-4ffb-8000-fbbe619ca0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:14 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Volume volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 (c1c50c7c-a880-4016-aeb2-6ce14af8b691): created successfully
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dbf2b7-4506-4ffb-8000-fbbe619ca0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Flow 'volume_create_manager' (452c18b4-b184-4666-a13a-bad71efbedab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:14 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-cb4c352c-d1d0-4b79-934e-624c19cb8ced tempest-SnapshotMetadataTestJSON-862899135 None] Created volume successfully.
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[339de62a-f115-4fc9-af5b-10a58fff0d62]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Creating offline snapshot d6f8926b-96ab-4596-a287-9d53e4f6be58 of volume c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482ebfe-085a-4a8e-b8b8-de666bd317e9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:14 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f
Sep 30 17:56:14 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:14 devstack sudo[94174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691
Sep 30 17:56:14 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:15 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:15 devstack sudo[94183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f
Sep 30 17:56:15 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:15 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691" returned: 0 in 0.398s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:15 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 1G
Sep 30 17:56:15 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:15 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-bb3c5a7c-6f4d-43c9-a5eb-efe9d64e684f" released by "delete_volume" :: held 0.820s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Created reservations ['e875e99d-40e5-4f00-a47a-fb97b6ec878c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:15 devstack cinder-volume[87418]: WARNING cinder.quota [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-391320783 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-391320783, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:15 devstack cinder-volume[87418]: WARNING cinder.quota [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-391320783 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-391320783, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Created reservations ['683bbcb8-1927-46a8-bfda-0040bcc7e57d', '30f7481b-a874-4991-8c44-9097dcc98270', '4c15dbc8-82b5-4507-8d3f-06ca7789da31', 'cb842674-0067-4328-8763-4b41f4edf0a9'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:15 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 1G" returned: 0 in 0.535s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:15 devstack sudo[94197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:15 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:15 devstack sudo[94199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58
Sep 30 17:56:15 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 23510bad-eb65-4b3c-bfb5-04c1fcbd5f75: deleting
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 23510bad-eb65-4b3c-bfb5-04c1fcbd5f75: deleting {{(pid=87418) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 30 17:56:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-7a0a88db-503b-4f24-9daa-c2f29940dbba" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:16 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-7a0a88db-503b-4f24-9daa-c2f29940dbba" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-45fc1c27-cf7e-41af-a798-a82708742d94" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-45fc1c27-cf7e-41af-a798-a82708742d94" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Deleting offline snapshot 45fc1c27-cf7e-41af-a798-a82708742d94 of volume 7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] snapshot_file for this snap is: volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:56:16 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c8878d28-c52d-486e-a5fd-bbf7d90ff97a tempest-GroupSnapshotsTest-483800652 None] Delete group completed successfully.
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[324fa26a-b008-489b-b621-85bf5213b3a8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:16 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58" returned: 0 in 0.566s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:16 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 is being set with open permissions: ugo+rw
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:16 devstack sudo[94208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58
Sep 30 17:56:16 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:16 devstack sudo[94207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94
Sep 30 17:56:16 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:16 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58" returned: 0 in 0.342s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:16 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94" returned: 0 in 0.500s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a0a88db-503b-4f24-9daa-c2f29940dbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:56:16 devstack sudo[94216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info
Sep 30 17:56:16 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8a6d0-2536-4234-971b-b322510d52fc]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:16 devstack sudo[94218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba
Sep 30 17:56:16 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:16 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info" returned: 0 in 0.321s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:16 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info is being set with open permissions: ugo+rw
Sep 30 17:56:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:16 devstack sudo[94228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info
Sep 30 17:56:16 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:17 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.info" returned: 0 in 0.306s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-646594f1-b7c7-40b0-851c-205eec98a0d9 tempest-SnapshotMetadataTestJSON-862899135 None] Create snapshot completed successfully
Sep 30 17:56:17 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba" returned: 0 in 0.623s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:17 devstack sudo[94234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94
Sep 30 17:56:17 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:17 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94" returned: 0 in 0.331s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:17 devstack sudo[94239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94
Sep 30 17:56:17 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:17 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba.45fc1c27-cf7e-41af-a798-a82708742d94" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-45fc1c27-cf7e-41af-a798-a82708742d94" released by "_delete_snapshot" :: held 1.907s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-7a0a88db-503b-4f24-9daa-c2f29940dbba" released by "delete_snapshot" :: held 1.951s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:18 devstack cinder-volume[87418]: WARNING cinder.quota [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-391320783 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-391320783, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['ab7be9d7-d664-40ed-a3ac-59bcdf9f2b0e', '4a8c47f1-133a-4808-905f-90a23bca95e4', '02fa10f9-f481-4d33-9285-d232f63bdbfb', '35bd856d-f62d-41eb-86a0-fc608fc96405'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3d8489fb-9700-46f3-9dca-49a4d3d3ebc4 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 23510bad-eb65-4b3c-bfb5-04c1fcbd5f75: deleted successfully
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "cinder-d6f8926b-96ab-4596-a287-9d53e4f6be58-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-d6f8926b-96ab-4596-a287-9d53e4f6be58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "cinder-quobyte-c1c50c7c-a880-4016-aeb2-6ce14af8b691" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-quobyte-c1c50c7c-a880-4016-aeb2-6ce14af8b691" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "cinder-quobyte-d6f8926b-96ab-4596-a287-9d53e4f6be58" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-quobyte-d6f8926b-96ab-4596-a287-9d53e4f6be58" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Deleting offline snapshot d6f8926b-96ab-4596-a287-9d53e4f6be58 of volume c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] snapshot_file for this snap is: volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[99546470-9d93-4519-96ce-8e229cdb79dc]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-7a0a88db-503b-4f24-9daa-c2f29940dbba" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-7a0a88db-503b-4f24-9daa-c2f29940dbba" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f73db-8228-429c-abf2-4a047082209e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:18 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58
Sep 30 17:56:18 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:18 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba
Sep 30 17:56:18 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:19 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58" returned: 0 in 0.455s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f4883-67db-4d4a-ae1e-3d67014a5b41]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:19 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba" returned: 0 in 0.482s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:19 devstack sudo[94254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691
Sep 30 17:56:19 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:19 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba
Sep 30 17:56:19 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:19 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691" returned: 0 in 0.449s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:19 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a0a88db-503b-4f24-9daa-c2f29940dbba" returned: 0 in 0.354s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:19 devstack sudo[94265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58
Sep 30 17:56:19 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-7a0a88db-503b-4f24-9daa-c2f29940dbba" released by "delete_volume" :: held 0.910s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Created reservations ['0991c864-efe3-4966-895d-417d63f4ca3d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:19 devstack cinder-volume[87418]: WARNING cinder.db.api [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-391320783']
Sep 30 17:56:19 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Created reservations ['aab8731c-1574-4bf1-9ad8-1436a8ef768d', '45ec4a50-0b5f-4375-be1e-fc5570f525b8', '092a976c-e49a-469d-be82-f2d09419ec9b', '5d177175-4ad6-4345-91d3-2c3ce4192aa1'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:20 devstack sudo[94273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:20 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:20 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58" returned: 0 in 0.466s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:20 devstack sudo[94278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58
Sep 30 17:56:20 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:20 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.362s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3f316f38-85e0-42f5-a8c6-c87624f7ecea tempest-GroupSnapshotsTest-483800652 None] Delete group completed successfully.
Sep 30 17:56:20 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691.d6f8926b-96ab-4596-a287-9d53e4f6be58" returned: 0 in 0.356s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-quobyte-d6f8926b-96ab-4596-a287-9d53e4f6be58" released by "_delete_snapshot" :: held 1.896s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-quobyte-c1c50c7c-a880-4016-aeb2-6ce14af8b691" released by "delete_snapshot" :: held 1.926s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:20 devstack cinder-volume[87418]: WARNING cinder.quota [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Created reservations ['106e69b0-8aee-4c08-abbd-e13b4ba15967', 'cc28d678-8867-45be-8127-3342275c008c', '8b07376a-d7ae-4bb7-9f4c-b3bfb511a1a8', 'e8188f85-9a76-4032-873b-d9ccf692b859'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Delete snapshot completed successfully.
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-348f1bd4-996c-4157-8dd5-6692bd7fad0a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-d6f8926b-96ab-4596-a287-9d53e4f6be58-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "cinder-c1c50c7c-a880-4016-aeb2-6ce14af8b691-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-c1c50c7c-a880-4016-aeb2-6ce14af8b691-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "cinder-quobyte-c1c50c7c-a880-4016-aeb2-6ce14af8b691" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-quobyte-c1c50c7c-a880-4016-aeb2-6ce14af8b691" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59267fef-9883-4833-bad9-385b0acc54d9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:21 devstack sudo[94304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691
Sep 30 17:56:21 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:21 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691" returned: 0 in 0.441s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:21 devstack sudo[94310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691
Sep 30 17:56:21 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ac778eab-a7bb-4ce2-ba31-207d356c6a2c tempest-GroupSnapshotsTest-483800652 None] Group tempest-GroupSnapshotsTest-Group-890895447: creating
Sep 30 17:56:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ac778eab-a7bb-4ce2-ba31-207d356c6a2c tempest-GroupSnapshotsTest-483800652 None] Group tempest-GroupSnapshotsTest-Group-890895447: created successfully
Sep 30 17:56:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ac778eab-a7bb-4ce2-ba31-207d356c6a2c tempest-GroupSnapshotsTest-483800652 None] Create group completed successfully.
Sep 30 17:56:21 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c1c50c7c-a880-4016-aeb2-6ce14af8b691" returned: 0 in 0.291s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-quobyte-c1c50c7c-a880-4016-aeb2-6ce14af8b691" released by "delete_volume" :: held 0.806s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Created reservations ['7ccd5cb8-ce79-4c91-9bb5-e54cf5771454', 'a4685a2b-2d1d-4c8e-8958-b8be6fd0554c', '429dd72e-9347-4eb7-8a4a-aed42b271a5f', '55c4d4f6-fac9-4d37-9420-646eb479dbc9'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:21 devstack sudo[94315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:21 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:22 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.272s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:22 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:22 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Deleted volume successfully.
Sep 30 17:56:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8586ba04-54f5-4e85-93f0-01d2f0b2172a tempest-SnapshotMetadataTestJSON-862899135 None] Lock "cinder-c1c50c7c-a880-4016-aeb2-6ce14af8b691-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (de81e694-d72d-477c-acb1-4230898d635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a68cb5-3475-4f84-9821-c045f5910563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a68cb5-3475-4f84-9821-c045f5910563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-964943393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=adff7679-89b3-484b-b1c1-83721cb28728,host='devstack@QuobyteHD#QuobyteHD',id=0db597a8-c737-473a-98e8-b1a9120ac075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:23Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e612f311-9e13-4c93-b045-cd0799f5b248),volume_type_id=e612f311-9e13-4c93-b045-cd0799f5b248)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ba1ced-f587-4f4e-b029-5e58b00246c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ba1ced-f587-4f4e-b029-5e58b00246c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61045ec-83f9-4951-9bae-63121e51a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61045ec-83f9-4951-9bae-63121e51a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db597a8-c737-473a-98e8-b1a9120ac075', 'volume_name': 'volume-0db597a8-c737-473a-98e8-b1a9120ac075', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548ec80e-6164-4eb8-9d53-98e1918d2d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548ec80e-6164-4eb8-9d53-98e1918d2d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab1da1a-28d7-401f-ba8a-e80d910c3150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Volume 0db597a8-c737-473a-98e8-b1a9120ac075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db597a8-c737-473a-98e8-b1a9120ac075', 'volume_size': 1}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=adff7679-89b3-484b-b1c1-83721cb28728,created_at=2026-09-30T15:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-964943393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=adff7679-89b3-484b-b1c1-83721cb28728,host='devstack@QuobyteHD#QuobyteHD',id=0db597a8-c737-473a-98e8-b1a9120ac075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:23Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e612f311-9e13-4c93-b045-cd0799f5b248),volume_type_id=e612f311-9e13-4c93-b045-cd0799f5b248)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Creating volume 0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:23 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:23 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 1073741824
Sep 30 17:56:23 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:24 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 1073741824" returned: 0 in 0.672s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:24 devstack sudo[94325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075
Sep 30 17:56:24 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:24 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab1da1a-28d7-401f-ba8a-e80d910c3150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db597a8-c737-473a-98e8-b1a9120ac075', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613b9afe-c76e-4e58-b529-7f644f6048a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:24 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Volume volume-0db597a8-c737-473a-98e8-b1a9120ac075 (0db597a8-c737-473a-98e8-b1a9120ac075): created successfully
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613b9afe-c76e-4e58-b529-7f644f6048a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (de81e694-d72d-477c-acb1-4230898d635e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8fa5d971-bbf1-4476-b60c-7599205a49ec tempest-GroupSnapshotsTest-483800652 None] Created volume successfully.
Sep 30 17:56:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-ff8d9e41-397f-4f49-84b9-175d6c482632 req-fafdd0e2-194a-4375-8cb9-d02fced0a5e1 tempest-AttachVolumeNegativeTest-914970347 None] Terminate volume connection completed successfully.
Sep 30 17:56:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-ff8d9e41-397f-4f49-84b9-175d6c482632 req-fafdd0e2-194a-4375-8cb9-d02fced0a5e1 tempest-AttachVolumeNegativeTest-914970347 None] Deleting attachment b85ccdf6-f183-425d-8248-3d899b43c8f6. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (59613ae3-1b18-485f-a0d7-b716a57b5ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad53fb9-8991-4d42-88d6-d9fd0b7524f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad53fb9-8991-4d42-88d6-d9fd0b7524f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2138221164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=adff7679-89b3-484b-b1c1-83721cb28728,host='devstack@QuobyteHD#QuobyteHD',id=35fd918d-b7c1-495b-ab41-4a1fb3272aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:27Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e612f311-9e13-4c93-b045-cd0799f5b248),volume_type_id=e612f311-9e13-4c93-b045-cd0799f5b248)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a25daf-e32c-447e-a802-79700410fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a25daf-e32c-447e-a802-79700410fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f39a04-9566-4144-a56e-0e204b7c5696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f39a04-9566-4144-a56e-0e204b7c5696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fd918d-b7c1-495b-ab41-4a1fb3272aab', 'volume_name': 'volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee0cbe7-6042-4c12-b62c-dfd439e25469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee0cbe7-6042-4c12-b62c-dfd439e25469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf75e56c-c182-4675-8ab6-6ea5167cf70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Volume 35fd918d-b7c1-495b-ab41-4a1fb3272aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab', 'volume_size': 1}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=adff7679-89b3-484b-b1c1-83721cb28728,created_at=2026-09-30T15:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2138221164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=adff7679-89b3-484b-b1c1-83721cb28728,host='devstack@QuobyteHD#QuobyteHD',id=35fd918d-b7c1-495b-ab41-4a1fb3272aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:27Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e612f311-9e13-4c93-b045-cd0799f5b248),volume_type_id=e612f311-9e13-4c93-b045-cd0799f5b248)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Creating volume 35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:26 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:26 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab 1073741824
Sep 30 17:56:26 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:27 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab 1073741824" returned: 0 in 0.600s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:27 devstack sudo[94376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab
Sep 30 17:56:27 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:27 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab" returned: 0 in 0.300s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf75e56c-c182-4675-8ab6-6ea5167cf70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02958992-af7e-4125-b626-94ad13d1ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Volume volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab (35fd918d-b7c1-495b-ab41-4a1fb3272aab): created successfully
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02958992-af7e-4125-b626-94ad13d1ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (59613ae3-1b18-485f-a0d7-b716a57b5ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-70dd0a6e-f712-4fad-bf83-89610f2f6ecf tempest-GroupSnapshotsTest-483800652 None] Created volume successfully.
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Flow 'volume_create_manager' (5c743252-0c4d-47de-88e6-34f79654e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dd918e-b034-4f96-b9be-5a5519e405aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dd918e-b034-4f96-b9be-5a5519e405aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-826529884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce9ddb9-ce09-465b-bda1-7afb694eeee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0aefc1a4f52457cbfa402913d6ba637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:29Z,use_quota=True,user_id='77d6b2c45ee34bc6aa6cbbbe72688460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6781666-a599-478c-a4a6-908fc125eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6781666-a599-478c-a4a6-908fc125eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af77cde-2678-4a91-980e-e70f9f6e7555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af77cde-2678-4a91-980e-e70f9f6e7555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce9ddb9-ce09-465b-bda1-7afb694eeee8', 'volume_name': 'volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e3d19d-4564-4bec-a254-2978dab263eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e3d19d-4564-4bec-a254-2978dab263eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e144e5c7-c5e8-4837-a833-c0846f38900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Volume 6ce9ddb9-ce09-465b-bda1-7afb694eeee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8', 'volume_size': 1}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-826529884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce9ddb9-ce09-465b-bda1-7afb694eeee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0aefc1a4f52457cbfa402913d6ba637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:29Z,use_quota=True,user_id='77d6b2c45ee34bc6aa6cbbbe72688460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Creating volume 6ce9ddb9-ce09-465b-bda1-7afb694eeee8 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:28 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:28 devstack sudo[94381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 1073741824
Sep 30 17:56:28 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:29 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 1073741824" returned: 0 in 0.462s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:29 devstack sudo[94386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8
Sep 30 17:56:29 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1111fdd2-d29b-4a81-b21f-5cd62363c6ae tempest-GroupSnapshotsTest-483800652 None] Update group completed successfully.
Sep 30 17:56:29 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8" returned: 0 in 0.242s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e144e5c7-c5e8-4837-a833-c0846f38900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdff83e5-5190-44db-a2d1-5f0d14174470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:29 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Volume volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 (6ce9ddb9-ce09-465b-bda1-7afb694eeee8): created successfully
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdff83e5-5190-44db-a2d1-5f0d14174470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Flow 'volume_create_manager' (5c743252-0c4d-47de-88e6-34f79654e082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-41ef4aa2-413e-4f91-8b88-08642717c850 tempest-VolumesTransfersTest-224360740 None] Created volume successfully.
Sep 30 17:56:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-4719126b-6d3d-46af-968e-1e4980debd81 tempest-GroupSnapshotsTest-483800652 None] Update group completed successfully.
Sep 30 17:56:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-529e3387-bfd9-4e3d-adf2-9b5e02c64320 tempest-VolumesTransfersTest-1419571827 None] Transfer volume completed successfully.
Sep 30 17:56:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2a43d3c0-dd46-436b-9abf-7d0acaccfcc9 tempest-GroupSnapshotsTest-483800652 None] Update group completed successfully.
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Acquiring lock "cinder-6ce9ddb9-ce09-465b-bda1-7afb694eeee8-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-6ce9ddb9-ce09-465b-bda1-7afb694eeee8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Acquiring lock "cinder-quobyte-6ce9ddb9-ce09-465b-bda1-7afb694eeee8" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-quobyte-6ce9ddb9-ce09-465b-bda1-7afb694eeee8" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4b929-bdfc-4d88-8323-a85f246ba2c1]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:32 devstack sudo[94390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8
Sep 30 17:56:32 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:32 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8" returned: 0 in 0.380s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:32 devstack sudo[94395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8
Sep 30 17:56:32 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:32 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6ce9ddb9-ce09-465b-bda1-7afb694eeee8" returned: 0 in 0.265s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-quobyte-6ce9ddb9-ce09-465b-bda1-7afb694eeee8" released by "delete_volume" :: held 0.698s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Created reservations ['8dc33f5b-330c-4c1c-90d5-4a650a7fc602', 'b45e0a39-85b6-4156-bf92-1eabcd27a8c8', '99472820-fca5-4097-8197-d534b0c7551a', 'ee0f1fe5-cd5e-4598-9db9-f63445b5d087'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c721edef-59cb-4e7a-88b5-a8b81c707f5e tempest-GroupSnapshotsTest-483800652 None] Update group completed successfully.
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:32 devstack sudo[94400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:32 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:33 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Deleted volume successfully.
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3e6d5cdf-f1b7-446f-a0dc-63b3ebdf9840 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-6ce9ddb9-ce09-465b-bda1-7afb694eeee8-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Flow 'volume_create_manager' (a4b38e67-a310-4172-acba-7224ac2b238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe65fd-1b98-42ba-a400-ba3c044e8123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe65fd-1b98-42ba-a400-ba3c044e8123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-769892681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fd0c8f-c907-4f87-81e6-2c263670cab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0aefc1a4f52457cbfa402913d6ba637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:34Z,use_quota=True,user_id='77d6b2c45ee34bc6aa6cbbbe72688460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b820c68-7d47-4be1-8851-9e575cdb4b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b820c68-7d47-4be1-8851-9e575cdb4b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf934cce-f1ee-42cb-bdbb-ba35210d333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf934cce-f1ee-42cb-bdbb-ba35210d333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fd0c8f-c907-4f87-81e6-2c263670cab1', 'volume_name': 'volume-36fd0c8f-c907-4f87-81e6-2c263670cab1', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9951cb99-e427-4192-8c1e-df11ee2e8459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9951cb99-e427-4192-8c1e-df11ee2e8459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e3b7c0-9e30-40e9-86c3-62547f9f14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:33 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Volume 36fd0c8f-c907-4f87-81e6-2c263670cab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fd0c8f-c907-4f87-81e6-2c263670cab1', 'volume_size': 1}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-769892681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fd0c8f-c907-4f87-81e6-2c263670cab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0aefc1a4f52457cbfa402913d6ba637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:34Z,use_quota=True,user_id='77d6b2c45ee34bc6aa6cbbbe72688460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Creating volume 36fd0c8f-c907-4f87-81e6-2c263670cab1 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:33 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:33 devstack sudo[94403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 1073741824
Sep 30 17:56:33 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:34 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 1073741824" returned: 0 in 0.481s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:34 devstack sudo[94412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1
Sep 30 17:56:34 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] GroupSnapshot 2e75e5eb-4869-4f02-b1b3-fa573605b86e: creating.
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Group snapshot 2e75e5eb-4869-4f02-b1b3-fa573605b86e: creating. {{(pid=87418) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:34 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1" returned: 0 in 0.299s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.068s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e3b7c0-9e30-40e9-86c3-62547f9f14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fd0c8f-c907-4f87-81e6-2c263670cab1', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989729c2-1ce1-416e-b8b9-d45eb748487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Creating offline snapshot 259ad749-a14e-495c-aba7-ae766a2d0933 of volume 35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fc8ae1-374d-4ea7-862a-13ae9411da25]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Volume volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 (36fd0c8f-c907-4f87-81e6-2c263670cab1): created successfully
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989729c2-1ce1-416e-b8b9-d45eb748487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Flow 'volume_create_manager' (a4b38e67-a310-4172-acba-7224ac2b238d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1d835892-0d82-4c95-ba65-026e50c54acf tempest-VolumesTransfersTest-224360740 None] Created volume successfully.
Sep 30 17:56:34 devstack sudo[94415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab
Sep 30 17:56:34 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:35 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:35 devstack sudo[94421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 1G
Sep 30 17:56:35 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:35 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 1G" returned: 0 in 0.584s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:35 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933
Sep 30 17:56:35 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:36 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933" returned: 0 in 0.410s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:36 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:36 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933
Sep 30 17:56:36 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Acquiring lock "cinder-36fd0c8f-c907-4f87-81e6-2c263670cab1-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-36fd0c8f-c907-4f87-81e6-2c263670cab1-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Acquiring lock "cinder-quobyte-36fd0c8f-c907-4f87-81e6-2c263670cab1" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-quobyte-36fd0c8f-c907-4f87-81e6-2c263670cab1" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a64536-b676-46ce-a28b-3fd825887b4c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:36 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933" returned: 0 in 0.490s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:36 devstack sudo[94461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info
Sep 30 17:56:36 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:36 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1
Sep 30 17:56:36 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:37 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info" returned: 0 in 0.334s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:37 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:37 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1" returned: 0 in 0.508s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:37 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info
Sep 30 17:56:37 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:37 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1
Sep 30 17:56:37 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:37 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.info" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Creating offline snapshot 7b5ccd9a-b157-4b3d-9227-16aa599dc457 of volume 0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f4603d-91b6-4845-b125-2a59e46b609e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:37 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-36fd0c8f-c907-4f87-81e6-2c263670cab1" returned: 0 in 0.337s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-quobyte-36fd0c8f-c907-4f87-81e6-2c263670cab1" released by "delete_volume" :: held 0.933s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Created reservations ['2bc88915-0905-40f2-a43d-ac21a9ba64ea', '29518476-e4f4-410d-a432-34b9ce04b6b0', 'ab0ebdf5-50b3-4178-8e03-b12a71a43b9f', '16e854eb-a29b-40d3-b290-233ade490916'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:37 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075
Sep 30 17:56:37 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:37 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:37 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:38 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075" returned: 0 in 0.628s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:38 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.349s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Deleted volume successfully.
Sep 30 17:56:38 devstack sudo[94490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 1G
Sep 30 17:56:38 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3369a969-d130-46a3-970e-9c72e5768682 tempest-VolumesTransfersTest-2028192192 None] Lock "cinder-36fd0c8f-c907-4f87-81e6-2c263670cab1-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:38 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 1G" returned: 0 in 0.686s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db597a8-c737-473a-98e8-b1a9120ac075 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:38 devstack sudo[94532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db597a8-c737-473a-98e8-b1a9120ac075 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457
Sep 30 17:56:38 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:39 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db597a8-c737-473a-98e8-b1a9120ac075 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457" returned: 0 in 0.504s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:39 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:56:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:39 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457
Sep 30 17:56:39 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:39 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457" returned: 0 in 0.370s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:39 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info
Sep 30 17:56:39 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:39 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info" returned: 0 in 0.296s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:39 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:56:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:39 devstack sudo[94569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info
Sep 30 17:56:39 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:40 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.info" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:40 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-77574a47-2870-47f4-a4ef-bf5c43aa5c5b tempest-GroupSnapshotsTest-483800652 None] group_snapshot 2e75e5eb-4869-4f02-b1b3-fa573605b86e: created successfully
Sep 30 17:56:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 2e75e5eb-4869-4f02-b1b3-fa573605b86e: deleting
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 2e75e5eb-4869-4f02-b1b3-fa573605b86e: deleting {{(pid=87418) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-35fd918d-b7c1-495b-ab41-4a1fb3272aab" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-35fd918d-b7c1-495b-ab41-4a1fb3272aab" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-259ad749-a14e-495c-aba7-ae766a2d0933" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-259ad749-a14e-495c-aba7-ae766a2d0933" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Deleting offline snapshot 259ad749-a14e-495c-aba7-ae766a2d0933 of volume 35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] snapshot_file for this snap is: volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d40b3-99ed-475d-835f-717d5bf19bd8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:41 devstack sudo[94634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933
Sep 30 17:56:41 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-0dc3114c-eb66-40f2-98a1-27061e6a3257 tempest-ServerActionsTestOtherA-1846242258 None] Terminate volume connection completed successfully.
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-0dc3114c-eb66-40f2-98a1-27061e6a3257 tempest-ServerActionsTestOtherA-1846242258 None] Deleting attachment b173f8b4-6d86-4dc6-b638-d9cc38ba9956. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:56:42 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933" returned: 0 in 0.817s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "cinder-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dec948-d2b0-4058-9660-af3a779072fe]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "cinder-quobyte-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:42 devstack sudo[94663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab
Sep 30 17:56:42 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-quobyte-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" acquired by "delete_volume" :: waited 0.054s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6929e2ea-0b2b-489e-ba19-f30433753cbb]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:43 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c
Sep 30 17:56:43 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:43 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab" returned: 0 in 0.691s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:43 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933
Sep 30 17:56:43 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:43 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" returned: 0 in 0.875s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:43 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c
Sep 30 17:56:43 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:44 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:44 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-quobyte-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c" released by "delete_volume" :: held 1.372s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933" returned: 0 in 0.943s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:44 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933
Sep 30 17:56:44 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.quota [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Created reservations ['17bc350c-0667-4fdc-b596-ab415c237a39', '5dad202a-c778-4714-9233-49c1ae022ebe', 'ad6fddba-719d-42a1-88c2-913626cbc435', 'dfc749ce-f696-4c3d-83cc-d66e7e66a932'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:44 devstack sudo[94685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:44 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:44 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab.259ad749-a14e-495c-aba7-ae766a2d0933" returned: 0 in 0.541s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:44 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.343s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.manager [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-259ad749-a14e-495c-aba7-ae766a2d0933" released by "_delete_snapshot" :: held 3.217s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Deleted volume successfully.
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-35fd918d-b7c1-495b-ab41-4a1fb3272aab" released by "delete_snapshot" :: held 3.279s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-fc9ba30e-8678-416e-941a-550dd36f2e38 req-80951304-c576-49fe-b7b4-d9f3ce037d07 tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-a6e7e28e-1bbd-45bf-ab8e-a4b747f0797c-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-0db597a8-c737-473a-98e8-b1a9120ac075" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-0db597a8-c737-473a-98e8-b1a9120ac075" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-7b5ccd9a-b157-4b3d-9227-16aa599dc457" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-7b5ccd9a-b157-4b3d-9227-16aa599dc457" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Deleting offline snapshot 7b5ccd9a-b157-4b3d-9227-16aa599dc457 of volume 0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] snapshot_file for this snap is: volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[888234e9-7efe-4735-9522-060141a778df]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "cinder-84f1c370-47e0-4146-8312-be0dc54c802b-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-84f1c370-47e0-4146-8312-be0dc54c802b-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:45 devstack sudo[94689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457
Sep 30 17:56:45 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "cinder-quobyte-84f1c370-47e0-4146-8312-be0dc54c802b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-quobyte-84f1c370-47e0-4146-8312-be0dc54c802b" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e063e3-80bc-4ec9-b73d-8b2161b387ca]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:45 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b
Sep 30 17:56:45 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:45 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457" returned: 0 in 0.716s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0db597a8-c737-473a-98e8-b1a9120ac075(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[66985032-3ec9-431e-8e5b-b4a49d12f51b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:45 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075
Sep 30 17:56:45 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:45 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b" returned: 0 in 0.687s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:46 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b
Sep 30 17:56:46 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:46 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075" returned: 0 in 0.611s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:46 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457
Sep 30 17:56:46 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:46 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:46 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:46 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-84f1c370-47e0-4146-8312-be0dc54c802b" returned: 0 in 0.434s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-quobyte-84f1c370-47e0-4146-8312-be0dc54c802b" released by "delete_volume" :: held 1.239s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Created reservations ['54991def-ab35-4c22-a0b8-1fa5d6974e05', 'a20ec67d-456a-4e55-8a09-1dca98fdeee9', 'd0ac3127-8dd2-4bd3-9217-853c219f5b91', 'ec546ad2-25dd-4fe5-b6fa-532595936326'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:46 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.513s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:56:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:56:46 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:46 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:47 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457" returned: 0 in 0.672s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:47 devstack sudo[94719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457
Sep 30 17:56:47 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:47 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Deleted volume successfully.
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-77388c8e-68d0-4d63-a67f-6426c42d404f tempest-ServerActionsTestOtherA-1846242258 None] Lock "cinder-84f1c370-47e0-4146-8312-be0dc54c802b-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:47 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075.7b5ccd9a-b157-4b3d-9227-16aa599dc457" returned: 0 in 0.432s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-7b5ccd9a-b157-4b3d-9227-16aa599dc457" released by "_delete_snapshot" :: held 2.593s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-0db597a8-c737-473a-98e8-b1a9120ac075" released by "delete_snapshot" :: held 2.627s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:47 devstack cinder-volume[87418]: WARNING cinder.quota [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-443484280 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-443484280, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:47 devstack cinder-volume[87418]: WARNING cinder.quota [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-443484280 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-443484280, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:47 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['91c74d3a-a336-45e8-a518-85f44ac8db39', 'f66026bd-a49c-4cc3-8309-8373086a8e89', 'ef01d9d5-d99e-4036-9394-52d378f407f9', 'eb542271-173d-4a10-a972-de90b29fac9f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:48 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['c97d1a2e-73df-433a-93b9-fe4a61b990bf', '8b0234f1-485f-4c01-9104-87cc41d039e7', '60463294-812f-43a0-8993-e7004ff02ba0', 'e6b1ca80-d854-4776-bf5b-1aacde5fd16e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-df71f98b-8d7e-41fc-8b55-4f7a703f3af2 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 2e75e5eb-4869-4f02-b1b3-fa573605b86e: deleted successfully
Sep 30 17:56:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-0db597a8-c737-473a-98e8-b1a9120ac075" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-0db597a8-c737-473a-98e8-b1a9120ac075" acquired by "delete_volume" :: waited 0.045s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:49 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7db54b-40bf-42a5-acd8-f60674ffc791]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:49 devstack sudo[94751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075
Sep 30 17:56:49 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:50 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075" returned: 0 in 0.849s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:50 devstack sudo[94758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075
Sep 30 17:56:50 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:50 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0db597a8-c737-473a-98e8-b1a9120ac075" returned: 0 in 0.343s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-0db597a8-c737-473a-98e8-b1a9120ac075" released by "delete_volume" :: held 1.368s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-35fd918d-b7c1-495b-ab41-4a1fb3272aab" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-35fd918d-b7c1-495b-ab41-4a1fb3272aab" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5015bc-9e8a-4ddb-a1f1-8517def16fec]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:51 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab
Sep 30 17:56:51 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:51 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab" returned: 0 in 0.523s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:51 devstack sudo[94766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab
Sep 30 17:56:51 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:51 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35fd918d-b7c1-495b-ab41-4a1fb3272aab" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-35fd918d-b7c1-495b-ab41-4a1fb3272aab" released by "delete_volume" :: held 1.025s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:51 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['9ada6a12-7bfd-44c9-9d0d-08e337ba95a2'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:51 devstack cinder-volume[87418]: WARNING cinder.quota [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-443484280 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-443484280, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:56:51 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['abd4c0fe-04a6-4de3-ac7f-f887e9be5146', '6df0a890-13da-4dfb-9156-88a6100126e8', '36904326-7c5a-4665-bb2f-5deeb7049869', 'dae7e2c2-ec14-45a4-a57e-1b26ee89fadb'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['18afa782-4c8c-414c-a46a-95ebb289c506', 'cd722d02-576b-48aa-b6ec-a2c548fc3311', '187dbaa3-3f7a-41cc-9900-74017caeaa89', 'dc2fcd63-6894-482a-859d-15458714be0f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:52 devstack sudo[94769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:52 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:52 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:52 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7870b197-79ab-4be1-9eb1-5cc9b0390ec7 tempest-GroupSnapshotsTest-483800652 None] Delete group completed successfully.
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Flow 'volume_create_manager' (6b9c2d0c-ed79-4203-bc88-20569a52b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676ba753-8e41-4d0a-939d-ba80271b9bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676ba753-8e41-4d0a-939d-ba80271b9bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2135093891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885e3c77-70f7-4bf0-914f-4089b08c64df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34fa47ecd7c4b2ab930d01b61ca9933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:53Z,use_quota=True,user_id='edb3a0dcf63d43bb9ef458092183f12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed67566-efa3-4fa7-8e92-d44d4111fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed67566-efa3-4fa7-8e92-d44d4111fe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3248803-9017-4a4d-9aa1-bef5d43be072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3248803-9017-4a4d-9aa1-bef5d43be072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885e3c77-70f7-4bf0-914f-4089b08c64df', 'volume_name': 'volume-885e3c77-70f7-4bf0-914f-4089b08c64df', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262a8e5-8fb8-4fab-b859-4086332eca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262a8e5-8fb8-4fab-b859-4086332eca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f01dc3-a77a-45e2-9828-31776acc3b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:53 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Volume 885e3c77-70f7-4bf0-914f-4089b08c64df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885e3c77-70f7-4bf0-914f-4089b08c64df', 'volume_size': 1}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2135093891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885e3c77-70f7-4bf0-914f-4089b08c64df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34fa47ecd7c4b2ab930d01b61ca9933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:53Z,use_quota=True,user_id='edb3a0dcf63d43bb9ef458092183f12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Creating volume 885e3c77-70f7-4bf0-914f-4089b08c64df {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:53 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:53 devstack sudo[94773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df 1073741824
Sep 30 17:56:53 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:53 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df 1073741824" returned: 0 in 0.571s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:53 devstack sudo[94779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df
Sep 30 17:56:53 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a4af89c5-e4dd-486c-8f7a-60c9db0977ed tempest-GroupSnapshotsTest-483800652 None] Group tempest-GroupSnapshotsTest-Group-2030844114: creating
Sep 30 17:56:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a4af89c5-e4dd-486c-8f7a-60c9db0977ed tempest-GroupSnapshotsTest-483800652 None] Group tempest-GroupSnapshotsTest-Group-2030844114: created successfully
Sep 30 17:56:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a4af89c5-e4dd-486c-8f7a-60c9db0977ed tempest-GroupSnapshotsTest-483800652 None] Create group completed successfully.
Sep 30 17:56:54 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df" returned: 0 in 0.368s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f01dc3-a77a-45e2-9828-31776acc3b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885e3c77-70f7-4bf0-914f-4089b08c64df', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a81165-8d02-45d0-8fc6-505d3b6f4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Volume volume-885e3c77-70f7-4bf0-914f-4089b08c64df (885e3c77-70f7-4bf0-914f-4089b08c64df): created successfully
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a81165-8d02-45d0-8fc6-505d3b6f4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Flow 'volume_create_manager' (6b9c2d0c-ed79-4203-bc88-20569a52b14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-adf6db1e-a4bf-414e-b049-2972d5a16600 tempest-VolumesTransfersV357Test-327517600 None] Created volume successfully.
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (93cc20b2-c129-4a94-8b2c-9355136cfaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aefc78c-980a-4aea-a6d2-1cbaf25b9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aefc78c-980a-4aea-a6d2-1cbaf25b9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145377190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=acfeb1b4-0cbc-41d0-88c2-d279f4e91f87,host='devstack@QuobyteHD#QuobyteHD',id=977b8aef-9770-4114-b130-62e5bca44496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:56Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1e1a1d8-6d5f-4f63-ac10-97b97ee13f65),volume_type_id=d1e1a1d8-6d5f-4f63-ac10-97b97ee13f65)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189e8c96-ffb5-4b01-8bb3-936ff08f5773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189e8c96-ffb5-4b01-8bb3-936ff08f5773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed994b4d-9f0c-49dd-a1a7-37bd031ab475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed994b4d-9f0c-49dd-a1a7-37bd031ab475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977b8aef-9770-4114-b130-62e5bca44496', 'volume_name': 'volume-977b8aef-9770-4114-b130-62e5bca44496', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f13181-8994-42d9-9589-64afafb9ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f13181-8994-42d9-9589-64afafb9ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6849b3ba-4f45-4042-bac7-8426f682c4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Volume 977b8aef-9770-4114-b130-62e5bca44496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977b8aef-9770-4114-b130-62e5bca44496', 'volume_size': 1}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=acfeb1b4-0cbc-41d0-88c2-d279f4e91f87,created_at=2026-09-30T15:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145377190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=acfeb1b4-0cbc-41d0-88c2-d279f4e91f87,host='devstack@QuobyteHD#QuobyteHD',id=977b8aef-9770-4114-b130-62e5bca44496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec475d87cf34e9dbf30956b31624b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:56Z,use_quota=True,user_id='062be99e406c459fb94445b4516bf2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1e1a1d8-6d5f-4f63-ac10-97b97ee13f65),volume_type_id=d1e1a1d8-6d5f-4f63-ac10-97b97ee13f65)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Creating volume 977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:56:55 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:56:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:55 devstack sudo[94784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 1073741824
Sep 30 17:56:55 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-534e2a8d-e244-480e-8b0b-9a7f9fc7d080 tempest-VolumesTransfersV357Test-235032458 None] Transfer volume completed successfully.
Sep 30 17:56:56 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 1073741824" returned: 0 in 0.722s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:56 devstack sudo[94810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496
Sep 30 17:56:56 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Acquiring lock "cinder-885e3c77-70f7-4bf0-914f-4089b08c64df-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-885e3c77-70f7-4bf0-914f-4089b08c64df-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Acquiring lock "cinder-quobyte-885e3c77-70f7-4bf0-914f-4089b08c64df" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:56:57 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496" returned: 0 in 0.345s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-quobyte-885e3c77-70f7-4bf0-914f-4089b08c64df" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6849b3ba-4f45-4042-bac7-8426f682c4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977b8aef-9770-4114-b130-62e5bca44496', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa10c88c-057d-4b80-9268-8c579948bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a4a1a9-639f-4e1b-8710-3005d0603c63]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Volume volume-977b8aef-9770-4114-b130-62e5bca44496 (977b8aef-9770-4114-b130-62e5bca44496): created successfully
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa10c88c-057d-4b80-9268-8c579948bc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Flow 'volume_create_manager' (93cc20b2-c129-4a94-8b2c-9355136cfaa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-21b57414-1a9b-46c1-b2d7-af5be51cc8bb tempest-GroupSnapshotsTest-483800652 None] Created volume successfully.
Sep 30 17:56:57 devstack sudo[94813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df
Sep 30 17:56:57 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:57 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df" returned: 0 in 0.411s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:57 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df
Sep 30 17:56:57 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:57 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-885e3c77-70f7-4bf0-914f-4089b08c64df" returned: 0 in 0.258s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-quobyte-885e3c77-70f7-4bf0-914f-4089b08c64df" released by "delete_volume" :: held 0.739s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Created reservations ['bf17bcea-b50f-4855-9687-bdde06353862', 'fd1d7e87-83a3-4df3-8593-468aa50d04ce', '364fe4b2-f72a-49ca-a49e-9d27c68fa780', '02f3f7a3-6a57-41c7-98c3-42941d1a9ae3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:56:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:57 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:56:57 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:58 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.268s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:56:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Deleted volume successfully.
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-90d32091-e61d-4642-8472-dd3b19ae0268 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-885e3c77-70f7-4bf0-914f-4089b08c64df-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:56:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] GroupSnapshot 32f66346-c1c5-490a-8834-84ca240ed015: creating.
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Group snapshot 32f66346-c1c5-490a-8834-84ca240ed015: creating. {{(pid=87418) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Creating offline snapshot 64395f3c-6a93-435c-b97f-348caf8b2972 of volume 977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f95fce5-45d8-441f-ac4a-d8146a41233b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Flow 'volume_create_manager' (c63304ba-fba7-4717-a075-1c97774fd7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e068e811-6ab6-4aec-a4b5-562d13b5030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e068e811-6ab6-4aec-a4b5-562d13b5030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-681290906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517fce8c-575d-48f5-90fb-d5cd75ebc377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34fa47ecd7c4b2ab930d01b61ca9933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:59Z,use_quota=True,user_id='edb3a0dcf63d43bb9ef458092183f12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e8030-7a13-4c05-815e-d655490c9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e8030-7a13-4c05-815e-d655490c9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f003152e-c58d-4a82-bf6e-61b4b5c05a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f003152e-c58d-4a82-bf6e-61b4b5c05a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517fce8c-575d-48f5-90fb-d5cd75ebc377', 'volume_name': 'volume-517fce8c-575d-48f5-90fb-d5cd75ebc377', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12b8ba9-762a-4b59-94d9-fdbe9cd3c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12b8ba9-762a-4b59-94d9-fdbe9cd3c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94238ded-9baa-4aea-8fae-e69550a6e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:56:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Volume 517fce8c-575d-48f5-90fb-d5cd75ebc377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517fce8c-575d-48f5-90fb-d5cd75ebc377', 'volume_size': 1}
Sep 30 17:56:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:56:58 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496
Sep 30 17:56:58 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:59 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496" returned: 0 in 0.377s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:59 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 1G
Sep 30 17:56:59 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:59 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 1G" returned: 0 in 0.401s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977b8aef-9770-4114-b130-62e5bca44496 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:59 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977b8aef-9770-4114-b130-62e5bca44496 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972
Sep 30 17:56:59 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:56:59 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Sep 30 17:56:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977b8aef-9770-4114-b130-62e5bca44496 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972" returned: 0 in 0.303s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:56:59 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:56:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:56:59 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972
Sep 30 17:56:59 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:00 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:00 devstack sudo[94844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info
Sep 30 17:57:00 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:00 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:00 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:00 devstack sudo[94847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info
Sep 30 17:57:00 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:00 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.info" returned: 0 in 0.282s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-681290906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517fce8c-575d-48f5-90fb-d5cd75ebc377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34fa47ecd7c4b2ab930d01b61ca9933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:56:59Z,use_quota=True,user_id='edb3a0dcf63d43bb9ef458092183f12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Creating volume 517fce8c-575d-48f5-90fb-d5cd75ebc377 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:57:00 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:57:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:00 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 1073741824
Sep 30 17:57:00 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c49dcc38-fb84-47b3-9d34-4a83c321a079 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 32f66346-c1c5-490a-8834-84ca240ed015: created successfully
Sep 30 17:57:01 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 1073741824" returned: 0 in 0.473s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:01 devstack sudo[94856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377
Sep 30 17:57:01 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:01 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377" returned: 0 in 0.253s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94238ded-9baa-4aea-8fae-e69550a6e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517fce8c-575d-48f5-90fb-d5cd75ebc377', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647451fe-f8f2-4f0b-ad55-5c72e3c251a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:01 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Volume volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 (517fce8c-575d-48f5-90fb-d5cd75ebc377): created successfully
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647451fe-f8f2-4f0b-ad55-5c72e3c251a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Flow 'volume_create_manager' (c63304ba-fba7-4717-a075-1c97774fd7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c55e2d85-cac2-4c3f-aa72-b0175771e900 tempest-VolumesTransfersV357Test-327517600 None] Created volume successfully.
Sep 30 17:57:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 32f66346-c1c5-490a-8834-84ca240ed015: deleting
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 32f66346-c1c5-490a-8834-84ca240ed015: deleting {{(pid=87418) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-977b8aef-9770-4114-b130-62e5bca44496" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Acquiring lock "cinder-517fce8c-575d-48f5-90fb-d5cd75ebc377-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-977b8aef-9770-4114-b130-62e5bca44496" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-64395f3c-6a93-435c-b97f-348caf8b2972" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-517fce8c-575d-48f5-90fb-d5cd75ebc377-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-64395f3c-6a93-435c-b97f-348caf8b2972" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Deleting offline snapshot 64395f3c-6a93-435c-b97f-348caf8b2972 of volume 977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] snapshot_file for this snap is: volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1d17d6-539a-4e2c-9ae8-b0b01c0812e9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Acquiring lock "cinder-quobyte-517fce8c-575d-48f5-90fb-d5cd75ebc377" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-quobyte-517fce8c-575d-48f5-90fb-d5cd75ebc377" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad5df23-412f-49db-91c1-102d55f446b2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:02 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972
Sep 30 17:57:02 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:02 devstack sudo[94861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377
Sep 30 17:57:02 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:02 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972" returned: 0 in 0.483s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-977b8aef-9770-4114-b130-62e5bca44496(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbcb229-e37b-4224-a69a-cc18a9ee6b3c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:02 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377" returned: 0 in 0.488s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:02 devstack sudo[94871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377
Sep 30 17:57:02 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:03 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496
Sep 30 17:57:03 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:03 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-517fce8c-575d-48f5-90fb-d5cd75ebc377" returned: 0 in 0.332s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-quobyte-517fce8c-575d-48f5-90fb-d5cd75ebc377" released by "delete_volume" :: held 0.882s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Created reservations ['5bb2d0c1-b641-42f4-bb15-a63217f055a2', '45afa327-05a4-40ad-bc04-33c52a46ebd2', '7210eb29-d00d-4556-b86b-3bbe219373f9', 'f749e866-c046-4f99-9de0-649314f115b5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:03 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496" returned: 0 in 0.509s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:03 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972
Sep 30 17:57:03 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:03 devstack sudo[94881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:57:03 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:03 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:57:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Deleted volume successfully.
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b1287bad-104e-4447-a96e-c0de3b3bb558 tempest-VolumesTransfersV357Test-1632651985 None] Lock "cinder-517fce8c-575d-48f5-90fb-d5cd75ebc377-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:03 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972" returned: 0 in 0.573s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:03 devstack sudo[94888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972
Sep 30 17:57:03 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:04 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496.64395f3c-6a93-435c-b97f-348caf8b2972" returned: 0 in 0.304s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-64395f3c-6a93-435c-b97f-348caf8b2972" released by "_delete_snapshot" :: held 2.034s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-977b8aef-9770-4114-b130-62e5bca44496" released by "delete_snapshot" :: held 2.081s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:04 devstack cinder-volume[87418]: WARNING cinder.quota [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1961502358 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1961502358, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:57:04 devstack cinder-volume[87418]: WARNING cinder.quota [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1961502358 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1961502358, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:57:04 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] Created reservations ['8004312c-8285-47e0-ae67-f88760cd5806', 'df28b6ba-9d75-4d58-9a54-338ab595774a', '92afbf9f-594c-494d-a8eb-0e8384562c14', '00f36a80-723f-45ce-86fd-6ec07d468471'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f4b0daf9-85b3-444c-8882-a454efabbbf2 tempest-GroupSnapshotsTest-483800652 None] group_snapshot 32f66346-c1c5-490a-8834-84ca240ed015: deleted successfully
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "cinder-quobyte-977b8aef-9770-4114-b130-62e5bca44496" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-977b8aef-9770-4114-b130-62e5bca44496" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb98807f-6ba3-43d7-93ca-9c9b4da47a30]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:05 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496
Sep 30 17:57:05 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:05 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496" returned: 0 in 0.448s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:05 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496
Sep 30 17:57:05 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:05 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-977b8aef-9770-4114-b130-62e5bca44496" returned: 0 in 0.301s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Lock "cinder-quobyte-977b8aef-9770-4114-b130-62e5bca44496" released by "delete_volume" :: held 0.842s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Created reservations ['aa905b8c-a52a-45b4-9dbb-f233403efd54'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:06 devstack cinder-volume[87418]: WARNING cinder.quota [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1961502358 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1961502358, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Created reservations ['ff3cf716-4f3b-48b7-8d82-13f1b3e462e2', '14bfe429-bf99-45eb-aef1-af23ed90b519', 'b1a1750f-854f-43e9-8a8b-900b83aabb78', 'd77b1c88-621c-42bc-bd4f-4ab630ada27b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:06 devstack sudo[94900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:57:06 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:06 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.345s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:06 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:57:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0f811f2e-7bb2-4f6e-b0b1-ea87eaa5fd4d tempest-GroupSnapshotsTest-483800652 None] Delete group completed successfully.
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Flow 'volume_create_manager' (929eee4e-4d63-4a6b-bafd-3e3120dc6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e80e7b-6f13-403d-8b12-d43a4bf88cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e80e7b-6f13-403d-8b12-d43a4bf88cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1843751198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fc9bc2-2d4d-467f-89d5-9bd81625b258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e810dc290d264d2fbff670d69f2cf308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:08Z,use_quota=True,user_id='4260ee07e2a64883bc56f25d0fde1230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56b70b1-9c05-4a85-9d82-f7fae9e2cf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56b70b1-9c05-4a85-9d82-f7fae9e2cf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19185577-9aec-4c53-94fe-c1a217069854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19185577-9aec-4c53-94fe-c1a217069854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37fc9bc2-2d4d-467f-89d5-9bd81625b258', 'volume_name': 'volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b0a54e-b4a3-43cf-ac2d-8ee4fb001c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b0a54e-b4a3-43cf-ac2d-8ee4fb001c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3493e11-2049-41ea-9536-568948e38e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Volume 37fc9bc2-2d4d-467f-89d5-9bd81625b258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258', 'volume_size': 1}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1843751198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fc9bc2-2d4d-467f-89d5-9bd81625b258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e810dc290d264d2fbff670d69f2cf308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:08Z,use_quota=True,user_id='4260ee07e2a64883bc56f25d0fde1230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Creating volume 37fc9bc2-2d4d-467f-89d5-9bd81625b258 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:57:08 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:57:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:08 devstack sudo[94905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 1073741824
Sep 30 17:57:08 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:09 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 1073741824" returned: 0 in 0.525s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:09 devstack sudo[94911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258
Sep 30 17:57:09 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:09 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258" returned: 0 in 0.336s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3493e11-2049-41ea-9536-568948e38e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a74c962-b598-4dd3-a577-856aa57d82d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:09 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Volume volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 (37fc9bc2-2d4d-467f-89d5-9bd81625b258): created successfully
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a74c962-b598-4dd3-a577-856aa57d82d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Flow 'volume_create_manager' (929eee4e-4d63-4a6b-bafd-3e3120dc6188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-26393b47-00e2-4d2d-906e-db0a4b4d51b4 tempest-AttachVolumeNegativeTest-914970347 None] Created volume successfully.
Sep 30 17:57:12 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=155,cinder:UPDATE=180,cinder:INSERT=45,cinder:DELETE=10 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:57:12 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=161,cinder:UPDATE=179,cinder:INSERT=41,cinder:DELETE=7 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:57:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-d65e6d98-5af4-42a1-a9a6-2cfbf6b8cb90 req-e68b4768-35c6-4797-b84a-6c23ac676306 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-d65e6d98-5af4-42a1-a9a6-2cfbf6b8cb90 req-e68b4768-35c6-4797-b84a-6c23ac676306 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-d65e6d98-5af4-42a1-a9a6-2cfbf6b8cb90 req-e68b4768-35c6-4797-b84a-6c23ac676306 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-d65e6d98-5af4-42a1-a9a6-2cfbf6b8cb90 req-e68b4768-35c6-4797-b84a-6c23ac676306 tempest-AttachVolumeNegativeTest-914970347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2b91162-4dd5-4fd6-8263-0ebfa910f24a', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:57:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-d65e6d98-5af4-42a1-a9a6-2cfbf6b8cb90 req-e68b4768-35c6-4797-b84a-6c23ac676306 tempest-AttachVolumeNegativeTest-914970347 None] attachment_update completed successfully.
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Flow 'volume_create_manager' (7e052d88-645c-4a57-b1a0-4bf1c88ba9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7053bf-a51b-491d-a6c6-485e67b35326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7053bf-a51b-491d-a6c6-485e67b35326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1260574216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0ea257-872b-4194-b2d8-77521564836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8636afaae60e475881ec081bc3850d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:14Z,use_quota=True,user_id='ea497febed5a44e8a4e7106b8a471bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d37ff5-363b-45ff-998e-5b3d9d6963a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d37ff5-363b-45ff-998e-5b3d9d6963a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e38388-8207-4624-a1c5-60c65db8548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e38388-8207-4624-a1c5-60c65db8548e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0ea257-872b-4194-b2d8-77521564836f', 'volume_name': 'volume-1f0ea257-872b-4194-b2d8-77521564836f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09f24a1-cd03-457f-8b33-0edf9664ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09f24a1-cd03-457f-8b33-0edf9664ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765c02a1-ff2d-4a04-b414-512bbb340218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:13 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Volume 1f0ea257-872b-4194-b2d8-77521564836f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0ea257-872b-4194-b2d8-77521564836f', 'volume_size': 1}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1260574216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0ea257-872b-4194-b2d8-77521564836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8636afaae60e475881ec081bc3850d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:14Z,use_quota=True,user_id='ea497febed5a44e8a4e7106b8a471bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Creating volume 1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:57:13 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:57:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:13 devstack sudo[95346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f 1073741824
Sep 30 17:57:13 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:14 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f 1073741824" returned: 0 in 0.579s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:14 devstack sudo[95353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f
Sep 30 17:57:14 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:14 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765c02a1-ff2d-4a04-b414-512bbb340218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0ea257-872b-4194-b2d8-77521564836f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bf323d-207c-4e49-8485-2258381cda28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:14 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Volume volume-1f0ea257-872b-4194-b2d8-77521564836f (1f0ea257-872b-4194-b2d8-77521564836f): created successfully
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bf323d-207c-4e49-8485-2258381cda28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Flow 'volume_create_manager' (7e052d88-645c-4a57-b1a0-4bf1c88ba9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:14 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-03ec2e44-6b30-4ef0-ad44-ba3ffad7257a tempest-VolumesCloneTest-727361250 None] Created volume successfully.
Sep 30 17:57:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-bb421669-703e-4d97-ac30-4e2cba4eebcd req-e10bebe9-4289-4b56-9261-9e581173e990 tempest-AttachVolumeNegativeTest-914970347 None] Terminate volume connection completed successfully.
Sep 30 17:57:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-bb421669-703e-4d97-ac30-4e2cba4eebcd req-e10bebe9-4289-4b56-9261-9e581173e990 tempest-AttachVolumeNegativeTest-914970347 None] Deleting attachment e2b91162-4dd5-4fd6-8263-0ebfa910f24a. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:57:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9f8802c8-b0a3-49b8-8ccc-6a33bf422f28 tempest-GroupsV320Test-116876404 None] Group tempest-GroupsV320Test-Group-879736999: creating
Sep 30 17:57:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9f8802c8-b0a3-49b8-8ccc-6a33bf422f28 tempest-GroupsV320Test-116876404 None] Group tempest-GroupsV320Test-Group-879736999: created successfully
Sep 30 17:57:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9f8802c8-b0a3-49b8-8ccc-6a33bf422f28 tempest-GroupsV320Test-116876404 None] Create group completed successfully.
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Flow 'volume_create_manager' (2b15ff01-c841-4e50-bcb8-e9cd01db6217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2a52d7-d533-4a49-ab16-5f84a1a3e189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2a52d7-d533-4a49-ab16-5f84a1a3e189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1420156871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6221948d-3072-4008-913e-fc40cabfb0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8636afaae60e475881ec081bc3850d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=1f0ea257-872b-4194-b2d8-77521564836f,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:17Z,use_quota=True,user_id='ea497febed5a44e8a4e7106b8a471bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba93b38-0e3c-4ae8-b2e3-e49741245cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba93b38-0e3c-4ae8-b2e3-e49741245cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b631fad-c1e4-4be2-b19d-fcf3e9789f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b631fad-c1e4-4be2-b19d-fcf3e9789f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6221948d-3072-4008-913e-fc40cabfb0de', 'volume_name': 'volume-6221948d-3072-4008-913e-fc40cabfb0de', 'volume_size': 2, 'source_volid': '1f0ea257-872b-4194-b2d8-77521564836f', 'source_volstatus': 'available'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b01b8b-dfc8-4891-96e2-16165693d11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b01b8b-dfc8-4891-96e2-16165693d11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934840f0-d37c-4032-8301-04a07aaa2068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:16 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Volume 6221948d-3072-4008-913e-fc40cabfb0de: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6221948d-3072-4008-913e-fc40cabfb0de', 'volume_size': 2, 'source_volid': '1f0ea257-872b-4194-b2d8-77521564836f', 'source_volstatus': 'available'}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:16 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Cloning volume 1f0ea257-872b-4194-b2d8-77521564836f to volume 6221948d-3072-4008-913e-fc40cabfb0de
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Creating offline snapshot a3791755-f6bc-4312-9bcc-3456e5ddeabd of volume 1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3f3034-e553-491f-9725-9ba8622f9289]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:17 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f
Sep 30 17:57:17 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:17 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:17 devstack sudo[95415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd 1G
Sep 30 17:57:17 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Created reservations ['3233bf52-52f2-48b1-b1e6-39764d3d72cc'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:17 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:57:17 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:17 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.385s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:17 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:57:18 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-74ca1d44-9a0c-436b-a746-07db2e0bea70 tempest-GroupsV320Test-116876404 None] Delete group completed successfully.
Sep 30 17:57:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd 1G" returned: 0 in 0.593s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0ea257-872b-4194-b2d8-77521564836f -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:18 devstack sudo[95427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0ea257-872b-4194-b2d8-77521564836f -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd
Sep 30 17:57:18 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:18 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0ea257-872b-4194-b2d8-77521564836f -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd" returned: 0 in 0.356s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:18 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd is being set with open permissions: ugo+rw
Sep 30 17:57:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:18 devstack sudo[95435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd
Sep 30 17:57:18 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:18 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:18 devstack sudo[95438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info
Sep 30 17:57:18 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:19 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info" returned: 0 in 0.424s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:19 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info is being set with open permissions: ugo+rw
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:19 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info
Sep 30 17:57:19 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:19 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.info" returned: 0 in 0.368s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Acquiring lock "cinder-quobyte-6221948d-3072-4008-913e-fc40cabfb0de" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-6221948d-3072-4008-913e-fc40cabfb0de" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] snapshot: a3791755-f6bc-4312-9bcc-3456e5ddeabd, volume: 6221948d-3072-4008-913e-fc40cabfb0de,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefef90b-42b5-418c-a686-f78216d4c81e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:19 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd
Sep 30 17:57:19 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:20 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd" returned: 0 in 0.554s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f0ea257-872b-4194-b2d8-77521564836f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3363fde-3a44-4dc7-91ae-fc545f6ed75e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:20 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f
Sep 30 17:57:20 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:20 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f" returned: 0 in 0.596s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 17:57:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:20 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de
Sep 30 17:57:20 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:28 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=21,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:57:28 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=5,cinder:SELECT=17,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:57:31 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de" returned: 0 in 10.613s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:31 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f, size 1024.00 MB, duration 10.61 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 17:57:31 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Converted 1024.00 MB image at 96.47 MB/s
Sep 30 17:57:31 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de is being set with open permissions: ugo+rw
Sep 30 17:57:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:31 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de
Sep 30 17:57:31 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:32 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de" returned: 0 in 0.685s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-6221948d-3072-4008-913e-fc40cabfb0de" released by "_copy_volume_from_snapshot" :: held 12.568s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Acquiring lock "cinder-quobyte-a3791755-f6bc-4312-9bcc-3456e5ddeabd" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-a3791755-f6bc-4312-9bcc-3456e5ddeabd" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Deleting offline snapshot a3791755-f6bc-4312-9bcc-3456e5ddeabd of volume 1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] snapshot_file for this snap is: volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7da043-61a1-4176-bc21-19c134a5ab53]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:32 devstack sudo[95582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd
Sep 30 17:57:32 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:33 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd" returned: 0 in 0.738s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f0ea257-872b-4194-b2d8-77521564836f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:57:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cca211-5899-41c0-b41a-2e2171c7f704]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:33 devstack sudo[95599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f
Sep 30 17:57:33 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:34 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f" returned: 0 in 1.072s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:34 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd
Sep 30 17:57:34 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:34 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd" returned: 0 in 0.678s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:34 devstack sudo[95617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd
Sep 30 17:57:34 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:35 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f.a3791755-f6bc-4312-9bcc-3456e5ddeabd" returned: 0 in 0.519s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-a3791755-f6bc-4312-9bcc-3456e5ddeabd" released by "_delete_snapshot" :: held 3.250s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.777s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934840f0-d37c-4032-8301-04a07aaa2068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6221948d-3072-4008-913e-fc40cabfb0de', 'volume_size': 2, 'source_volid': '1f0ea257-872b-4194-b2d8-77521564836f', 'source_volstatus': 'available'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ab250d-511c-4e9b-81d1-dd4d980e5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Volume volume-6221948d-3072-4008-913e-fc40cabfb0de (6221948d-3072-4008-913e-fc40cabfb0de): created successfully
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ab250d-511c-4e9b-81d1-dd4d980e5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Flow 'volume_create_manager' (2b15ff01-c841-4e50-bcb8-e9cd01db6217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c92b2d51-d842-4d72-bae8-8959a94e3d32 tempest-VolumesCloneTest-727361250 None] Created volume successfully.
Sep 30 17:57:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Acquiring lock "cinder-6221948d-3072-4008-913e-fc40cabfb0de-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Lock "cinder-6221948d-3072-4008-913e-fc40cabfb0de-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Acquiring lock "cinder-quobyte-6221948d-3072-4008-913e-fc40cabfb0de" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-6221948d-3072-4008-913e-fc40cabfb0de" acquired by "delete_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[69582fe1-9234-45d2-8336-d53d9c57ae34]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:37 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de
Sep 30 17:57:37 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:37 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de" returned: 0 in 0.932s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:37 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de
Sep 30 17:57:37 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:38 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6221948d-3072-4008-913e-fc40cabfb0de" returned: 0 in 0.647s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-6221948d-3072-4008-913e-fc40cabfb0de" released by "delete_volume" :: held 1.670s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Created reservations ['c5fe95f8-7a62-4d61-bc12-4323e25aa082', '2186f66c-a8f4-4d67-9c67-3df1f9a5fbdb', '6e7829f4-35ae-4d0b-8bbc-cbf2c20ad20c', 'ba4b3847-0f79-4f5e-b093-4b552e236c14'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:39 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:57:39 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Acquiring lock "cinder-1f0ea257-872b-4194-b2d8-77521564836f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Lock "cinder-1f0ea257-872b-4194-b2d8-77521564836f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Acquiring lock "cinder-quobyte-1f0ea257-872b-4194-b2d8-77521564836f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-1f0ea257-872b-4194-b2d8-77521564836f" acquired by "delete_volume" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f72ea6-1a00-4235-9de6-fbd248fda6f4]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:39 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.836s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:57:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Deleted volume successfully.
Sep 30 17:57:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-003475fd-ba96-4c0e-bd97-636620d99cc1 tempest-VolumesCloneTest-727361250 None] Lock "cinder-6221948d-3072-4008-913e-fc40cabfb0de-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:40 devstack sudo[95733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f
Sep 30 17:57:40 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:40 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f" returned: 0 in 1.062s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:40 devstack sudo[95770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f
Sep 30 17:57:40 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:41 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1f0ea257-872b-4194-b2d8-77521564836f" returned: 0 in 0.795s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Lock "cinder-quobyte-1f0ea257-872b-4194-b2d8-77521564836f" released by "delete_volume" :: held 2.038s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:41 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Created reservations ['4307afb1-5fb9-44a7-bdda-36a2ed8b3f7c', '21878b45-7c6e-4899-b9ac-1d33a63c74d9', '91ee4f6c-5d6b-42a0-8b88-fe597d05a31b', 'c9de44ce-c601-48d3-a034-d3aa313a134e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:42 devstack sudo[95783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:57:42 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:42 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.389s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:57:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Deleted volume successfully.
Sep 30 17:57:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28000e9c-474c-45f1-a19f-6d5f2fe10f8e tempest-VolumesCloneTest-727361250 None] Lock "cinder-1f0ea257-872b-4194-b2d8-77521564836f-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:46 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:57:46 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:46 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.346s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:57:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:57:47 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:57:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Flow 'volume_create_manager' (bff5d8dd-f272-45af-8ff8-6b4cf9828dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231cdc03-9266-43a9-8ddb-d101a1170053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231cdc03-9266-43a9-8ddb-d101a1170053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1424936395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e03e08-c423-4ca6-8687-ccc4d86dfed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44968f28115d4de9a361dae8551566cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:48Z,use_quota=True,user_id='7f670ee0171b4687b8eb924f5df85719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88550506-64f1-4176-9391-a7ce863c5e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88550506-64f1-4176-9391-a7ce863c5e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f85851f-9c7d-49ff-bdf4-4e5f37f6e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f85851f-9c7d-49ff-bdf4-4e5f37f6e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e03e08-c423-4ca6-8687-ccc4d86dfed5', 'volume_name': 'volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84193841-bd46-4af0-8e1a-c0555b14338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84193841-bd46-4af0-8e1a-c0555b14338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f903e20-5471-4386-af04-35533c2a886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5', 'volume_size': 1}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1424936395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e03e08-c423-4ca6-8687-ccc4d86dfed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44968f28115d4de9a361dae8551566cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:48Z,use_quota=True,user_id='7f670ee0171b4687b8eb924f5df85719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Creating volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:57:48 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:48 devstack sudo[95813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 1073741824
Sep 30 17:57:48 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:48 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 1073741824" returned: 0 in 0.559s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:48 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5
Sep 30 17:57:48 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" returned: 0 in 0.410s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:49 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f903e20-5471-4386-af04-35533c2a886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7689b6-8dd2-4e65-aec9-e2b4e809a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:49 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Volume volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 (b0e03e08-c423-4ca6-8687-ccc4d86dfed5): created successfully
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7689b6-8dd2-4e65-aec9-e2b4e809a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Flow 'volume_create_manager' (bff5d8dd-f272-45af-8ff8-6b4cf9828dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:49 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d8a5acf3-15e0-46fc-bb7f-107a100d159a tempest-VolumesSnapshotListTestJSON-101990410 None] Created volume successfully.
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Creating offline snapshot 4a4cf0a1-36aa-4268-aba0-462539cd05f0 of volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ca733c-1d0b-46dd-9417-d5db1beacff0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:50 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5
Sep 30 17:57:50 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:50 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" returned: 0 in 0.472s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:50 devstack sudo[95826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 1G
Sep 30 17:57:50 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:51 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 1G" returned: 0 in 0.551s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:51 devstack sudo[95832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:57:51 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:51 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.291s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:51 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 is being set with open permissions: ugo+rw
Sep 30 17:57:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:51 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:57:51 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:52 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:52 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info
Sep 30 17:57:52 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:52 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info" returned: 0 in 0.306s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:52 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info is being set with open permissions: ugo+rw
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:52 devstack sudo[95843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info
Sep 30 17:57:52 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:52 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.info" returned: 0 in 0.294s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-05b76cda-ccc6-4cc0-b1de-63219f4153d3 tempest-VolumesSnapshotListTestJSON-101990410 None] Create snapshot completed successfully
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Flow 'volume_create_manager' (a8a223b4-023c-4044-9350-5bb079f5416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98627d62-ff32-4970-afb2-9fdbaae33d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98627d62-ff32-4970-afb2-9fdbaae33d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1248493937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85af1ac2-6254-44e1-a107-cd6255a05fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c263bcbc1044a29b27078a8f067333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:53Z,use_quota=True,user_id='4132f96ebc0e470f81fcbe58f79eb1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51dfad1-c466-4274-b9bb-5c46cab192f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51dfad1-c466-4274-b9bb-5c46cab192f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e10939-0451-4b1b-90a5-e6f1bdc0c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e10939-0451-4b1b-90a5-e6f1bdc0c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85af1ac2-6254-44e1-a107-cd6255a05fdb', 'volume_name': 'volume-85af1ac2-6254-44e1-a107-cd6255a05fdb', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b7fe7e-8d40-4bd3-bcac-261503309183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b7fe7e-8d40-4bd3-bcac-261503309183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117bd782-ff98-4b21-9c66-3bd06c0236f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:53 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Volume 85af1ac2-6254-44e1-a107-cd6255a05fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85af1ac2-6254-44e1-a107-cd6255a05fdb', 'volume_size': 1}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1248493937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85af1ac2-6254-44e1-a107-cd6255a05fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c263bcbc1044a29b27078a8f067333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:53Z,use_quota=True,user_id='4132f96ebc0e470f81fcbe58f79eb1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Creating volume 85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:57:53 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:53 devstack sudo[95846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb 1073741824
Sep 30 17:57:53 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:53 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb 1073741824" returned: 0 in 0.443s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:53 devstack sudo[95863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb
Sep 30 17:57:53 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:53 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb" returned: 0 in 0.363s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.028s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117bd782-ff98-4b21-9c66-3bd06c0236f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85af1ac2-6254-44e1-a107-cd6255a05fdb', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436b1055-5a94-4b09-a587-ae1620bb63f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Creating offline snapshot b22fccfd-2567-49da-b37c-7f14365008a7 of volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:57:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Volume volume-85af1ac2-6254-44e1-a107-cd6255a05fdb (85af1ac2-6254-44e1-a107-cd6255a05fdb): created successfully
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436b1055-5a94-4b09-a587-ae1620bb63f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Flow 'volume_create_manager' (a8a223b4-023c-4044-9350-5bb079f5416c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1380a0a7-990b-4967-bbe1-b081e2eef465]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-bb87a313-4f5f-41af-858d-49fdc3813ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Created volume successfully.
Sep 30 17:57:54 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:57:54 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:54 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.371s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:54 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 1G
Sep 30 17:57:54 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:54 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 1G" returned: 0 in 0.477s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:54 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:57:54 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:55 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.348s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:55 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 is being set with open permissions: ugo+rw
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:55 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:57:55 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Flow 'volume_create_manager' (fc729918-630c-480d-8fd1-75066235291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e735566a-a9c5-448e-abfd-1369c2aec697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e735566a-a9c5-448e-abfd-1369c2aec697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-224959921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26901325-1bda-4917-92e4-28cac5b03c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524a0534fc94e05934cce5f06f5b74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:55Z,use_quota=True,user_id='e2cdc74a79b44a8bbf82da8a18953d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6292f8f-45d4-4b38-8c0b-24714342ee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6292f8f-45d4-4b38-8c0b-24714342ee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133f23a-8233-4fb2-bdb7-8412b21ad003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133f23a-8233-4fb2-bdb7-8412b21ad003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26901325-1bda-4917-92e4-28cac5b03c6e', 'volume_name': 'volume-26901325-1bda-4917-92e4-28cac5b03c6e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20d6ac7-2d16-4425-88e8-ad580c87bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20d6ac7-2d16-4425-88e8-ad580c87bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b398a3b3-b95e-477e-85ae-ccbe4c89c3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Volume 26901325-1bda-4917-92e4-28cac5b03c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26901325-1bda-4917-92e4-28cac5b03c6e', 'volume_size': 1}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:55 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.233s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.566s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Creating offline snapshot d3560a56-b232-426d-9dc4-fc54f251c4ae of volume 85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:57:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-cd13c239-c939-485a-b477-38a9e2057200 tempest-VolumesSnapshotListTestJSON-101990410 None] Create snapshot completed successfully
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdbd64e-08e7-47d7-a392-7141d2152750]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:55 devstack sudo[95911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb
Sep 30 17:57:55 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:55 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:55 devstack sudo[95917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae 1G
Sep 30 17:57:55 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:56 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae 1G" returned: 0 in 0.434s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85af1ac2-6254-44e1-a107-cd6255a05fdb -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:56 devstack sudo[95923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85af1ac2-6254-44e1-a107-cd6255a05fdb -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae
Sep 30 17:57:56 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:56 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85af1ac2-6254-44e1-a107-cd6255a05fdb -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:56 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae is being set with open permissions: ugo+rw
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:56 devstack sudo[95928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae
Sep 30 17:57:56 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:56 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:56 devstack sudo[95931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info
Sep 30 17:57:56 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:57 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info" returned: 0 in 0.253s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:57 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info is being set with open permissions: ugo+rw
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:57 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info
Sep 30 17:57:57 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:57 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.info" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-224959921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26901325-1bda-4917-92e4-28cac5b03c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524a0534fc94e05934cce5f06f5b74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:57:55Z,use_quota=True,user_id='e2cdc74a79b44a8bbf82da8a18953d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Creating volume 26901325-1bda-4917-92e4-28cac5b03c6e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:57:57 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:57 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e 1073741824
Sep 30 17:57:57 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c86aa2ea-3d48-4dfa-bdde-d7856672b3cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Create snapshot completed successfully
Sep 30 17:57:57 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e 1073741824" returned: 0 in 0.415s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:57 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e
Sep 30 17:57:57 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:58 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.974s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b398a3b3-b95e-477e-85ae-ccbe4c89c3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26901325-1bda-4917-92e4-28cac5b03c6e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2421161b-9d7c-4153-8604-277fb04fa5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Creating offline snapshot 72d1a939-c457-4d9c-ad65-d58899062297 of volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:57:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Volume volume-26901325-1bda-4917-92e4-28cac5b03c6e (26901325-1bda-4917-92e4-28cac5b03c6e): created successfully
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2421161b-9d7c-4153-8604-277fb04fa5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Flow 'volume_create_manager' (fc729918-630c-480d-8fd1-75066235291b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[164535cb-424d-4eee-9cf4-81a2b604b517]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a58b7ac9-e969-4597-8883-c8020687d399 tempest-AttachVolumeTestJSON-1438487512 None] Created volume successfully.
Sep 30 17:57:58 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:57:58 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:58 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:58 devstack sudo[95951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 1G
Sep 30 17:57:58 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "cinder-d3560a56-b232-426d-9dc4-fc54f251c4ae-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-d3560a56-b232-426d-9dc4-fc54f251c4ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "cinder-quobyte-85af1ac2-6254-44e1-a107-cd6255a05fdb" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-quobyte-85af1ac2-6254-44e1-a107-cd6255a05fdb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "cinder-quobyte-d3560a56-b232-426d-9dc4-fc54f251c4ae" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-quobyte-d3560a56-b232-426d-9dc4-fc54f251c4ae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Deleting offline snapshot d3560a56-b232-426d-9dc4-fc54f251c4ae of volume 85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] snapshot_file for this snap is: volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb31de48-3b85-4239-bc9f-7705b9d400d3]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:58 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae
Sep 30 17:57:58 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:59 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 1G" returned: 0 in 0.505s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:59 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297
Sep 30 17:57:59 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:59 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae" returned: 0 in 0.397s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85af1ac2-6254-44e1-a107-cd6255a05fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0a4e6d-e911-40a5-88b4-443f963b310f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:59 devstack sudo[95964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb
Sep 30 17:57:59 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:59 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:59 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 is being set with open permissions: ugo+rw
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:59 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297
Sep 30 17:57:59 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:59 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb" returned: 0 in 0.411s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:57:59 devstack sudo[95979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae
Sep 30 17:57:59 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:57:59 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:57:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.650s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:57:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-23aeb894-63ba-48d6-bbb8-444d43d7d0a4 tempest-VolumesSnapshotListTestJSON-101990410 None] Create snapshot completed successfully
Sep 30 17:58:00 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae" returned: 0 in 0.372s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:00 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae
Sep 30 17:58:00 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-428e393a-beb8-4deb-8e83-89fe25198c23 req-e4efc783-9a3a-4b6a-95a0-faecba005e57 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-428e393a-beb8-4deb-8e83-89fe25198c23 req-e4efc783-9a3a-4b6a-95a0-faecba005e57 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-428e393a-beb8-4deb-8e83-89fe25198c23 req-e4efc783-9a3a-4b6a-95a0-faecba005e57 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-428e393a-beb8-4deb-8e83-89fe25198c23 req-e4efc783-9a3a-4b6a-95a0-faecba005e57 tempest-AttachVolumeTestJSON-1438487512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-26901325-1bda-4917-92e4-28cac5b03c6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a10796f9-362c-4238-9a06-42deb0f2e92e', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:58:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-428e393a-beb8-4deb-8e83-89fe25198c23 req-e4efc783-9a3a-4b6a-95a0-faecba005e57 tempest-AttachVolumeTestJSON-1438487512 None] attachment_update completed successfully.
Sep 30 17:58:00 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb.d3560a56-b232-426d-9dc4-fc54f251c4ae" returned: 0 in 0.276s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-quobyte-d3560a56-b232-426d-9dc4-fc54f251c4ae" released by "_delete_snapshot" :: held 1.580s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-quobyte-85af1ac2-6254-44e1-a107-cd6255a05fdb" released by "delete_snapshot" :: held 1.610s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Created reservations ['bb7ecaf3-6d11-4e1e-9e33-496383aa73ab', 'a4a8859a-a150-41e0-9fe3-1efe288d0fd3', 'b8703682-497f-44c4-b6a9-4ce5e32b2754', 'aad99c6d-420f-4df9-affd-30bc74d87acd'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Delete snapshot completed successfully.
Sep 30 17:58:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-79ec9bbd-83c4-45e1-b543-0fc4be6bf648 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-d3560a56-b232-426d-9dc4-fc54f251c4ae-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "cinder-85af1ac2-6254-44e1-a107-cd6255a05fdb-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-85af1ac2-6254-44e1-a107-cd6255a05fdb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "cinder-quobyte-85af1ac2-6254-44e1-a107-cd6255a05fdb" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-quobyte-85af1ac2-6254-44e1-a107-cd6255a05fdb" acquired by "delete_volume" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69e637-b6db-4193-9ce1-f3b01baf31e2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:01 devstack sudo[96416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb
Sep 30 17:58:01 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-72d1a939-c457-4d9c-ad65-d58899062297-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-72d1a939-c457-4d9c-ad65-d58899062297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-72d1a939-c457-4d9c-ad65-d58899062297" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:01 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb" returned: 0 in 0.513s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-72d1a939-c457-4d9c-ad65-d58899062297" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Deleting offline snapshot 72d1a939-c457-4d9c-ad65-d58899062297 of volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:58:01 devstack sudo[96423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb
Sep 30 17:58:01 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] snapshot_file for this snap is: volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eb97d9-f86f-4e17-b4e9-c37bc968c9c2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:02 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297
Sep 30 17:58:02 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:02 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-85af1ac2-6254-44e1-a107-cd6255a05fdb" returned: 0 in 0.387s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-quobyte-85af1ac2-6254-44e1-a107-cd6255a05fdb" released by "delete_volume" :: held 1.006s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Created reservations ['8736f141-f20e-437a-a06b-38626c7895b6', '314c875f-c0d2-4723-a5cb-e0b036f097bc', '2d099403-e457-42e6-bdff-062b1046c741', 'eb4491d3-a2f6-4387-addb-f850d40cdb9c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:02 devstack sudo[96432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:02 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:02 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297" returned: 0 in 0.614s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc446c-41d2-4507-b1e0-ed60cbf0bac7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:02 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.371s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Deleted volume successfully.
Sep 30 17:58:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2c177e35-8d89-4380-ba73-b5bc9f81e302 tempest-VolumeSnapshotQuotasNegativeTestJSON-1207759589 None] Lock "cinder-85af1ac2-6254-44e1-a107-cd6255a05fdb-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:02 devstack sudo[96434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:58:02 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:03 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.636s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:03 devstack sudo[96449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297
Sep 30 17:58:03 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:03 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:03 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297
Sep 30 17:58:03 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:03 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.72d1a939-c457-4d9c-ad65-d58899062297" returned: 0 in 0.297s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-72d1a939-c457-4d9c-ad65-d58899062297" released by "_delete_snapshot" :: held 2.196s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" released by "delete_snapshot" :: held 2.239s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:04 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Created reservations ['5caafc7e-fe81-464a-9e84-76620242e5ef', 'd30723b1-73dc-4250-a278-628961b3129b', '91986d9e-3876-4c95-b080-da976dac20f3', 'af735668-eb5a-4ffa-a795-2a05f86507f9'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Delete snapshot completed successfully.
Sep 30 17:58:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e54e367d-81ff-4e71-a23e-8d3a87d0c88a tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-72d1a939-c457-4d9c-ad65-d58899062297-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-b22fccfd-2567-49da-b37c-7f14365008a7-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-b22fccfd-2567-49da-b37c-7f14365008a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-b22fccfd-2567-49da-b37c-7f14365008a7" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b22fccfd-2567-49da-b37c-7f14365008a7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Deleting offline snapshot b22fccfd-2567-49da-b37c-7f14365008a7 of volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] snapshot_file for this snap is: volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaad622-6363-41f0-8991-7aecf24e006f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:05 devstack sudo[96459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:58:05 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:05 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.659s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065b7b0-4332-4bb9-aa30-462782d19e63]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:06 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:58:06 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:06 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.585s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:06 devstack sudo[96619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:58:06 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Flow 'volume_create_manager' (d35a9ae8-e468-4392-b712-d0d6dcdd704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89f63d7-0f23-4f44-a47e-eb283e5affd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89f63d7-0f23-4f44-a47e-eb283e5affd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1169474248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153bd166-92da-431c-94ea-5bba880fb897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e810dc290d264d2fbff670d69f2cf308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:07Z,use_quota=True,user_id='4260ee07e2a64883bc56f25d0fde1230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d13fd38-5924-4afe-98c0-b6abd0ebc2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d13fd38-5924-4afe-98c0-b6abd0ebc2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abf9aee-9802-48f3-9f07-33ce9e0f0732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abf9aee-9802-48f3-9f07-33ce9e0f0732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153bd166-92da-431c-94ea-5bba880fb897', 'volume_name': 'volume-153bd166-92da-431c-94ea-5bba880fb897', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e553035-5455-46d3-ae85-73c136c9582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e553035-5455-46d3-ae85-73c136c9582e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61f41c6-247e-4286-b2bd-6cc31532b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Volume 153bd166-92da-431c-94ea-5bba880fb897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153bd166-92da-431c-94ea-5bba880fb897', 'volume_size': 1}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1169474248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153bd166-92da-431c-94ea-5bba880fb897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e810dc290d264d2fbff670d69f2cf308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:07Z,use_quota=True,user_id='4260ee07e2a64883bc56f25d0fde1230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Creating volume 153bd166-92da-431c-94ea-5bba880fb897 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:06 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:07 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897 1073741824
Sep 30 17:58:07 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:07 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.548s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:07 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7
Sep 30 17:58:07 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:07 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.b22fccfd-2567-49da-b37c-7f14365008a7" returned: 0 in 0.464s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b22fccfd-2567-49da-b37c-7f14365008a7" released by "_delete_snapshot" :: held 2.453s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" released by "delete_snapshot" :: held 2.495s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Created reservations ['ccf8a186-e3c6-465b-8660-8b958bd50fa5', '0b31297f-b510-4895-99c9-7d7a3d3cf0b7', 'c734155c-cda7-4ac4-ae56-e33eb3983207', '6c6d9275-bcf2-4436-b71c-900bc9a88ed1'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Delete snapshot completed successfully.
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a1e5ce01-594b-46ff-848f-23e6b4b36a99 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-b22fccfd-2567-49da-b37c-7f14365008a7-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:07 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897 1073741824" returned: 0 in 0.953s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:08 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897
Sep 30 17:58:08 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:08 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897" returned: 0 in 0.401s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-4a4cf0a1-36aa-4268-aba0-462539cd05f0-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61f41c6-247e-4286-b2bd-6cc31532b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153bd166-92da-431c-94ea-5bba880fb897', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233ef499-2dbd-4301-99ab-40bed0b681a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-4a4cf0a1-36aa-4268-aba0-462539cd05f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Volume volume-153bd166-92da-431c-94ea-5bba880fb897 (153bd166-92da-431c-94ea-5bba880fb897): created successfully
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233ef499-2dbd-4301-99ab-40bed0b681a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Flow 'volume_create_manager' (d35a9ae8-e468-4392-b712-d0d6dcdd704b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-4a4cf0a1-36aa-4268-aba0-462539cd05f0" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-308be014-40f8-41d7-8131-09f37e0f2749 tempest-AttachVolumeNegativeTest-914970347 None] Created volume successfully.
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-4a4cf0a1-36aa-4268-aba0-462539cd05f0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Deleting offline snapshot 4a4cf0a1-36aa-4268-aba0-462539cd05f0 of volume b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] snapshot_file for this snap is: volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6d7d5-a1ae-4ada-9a71-727c0cc9f5aa]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:08 devstack sudo[97018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:58:08 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:08 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.438s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b388bc-95c5-4bcb-9cd7-81b7a79836cd]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:09 devstack sudo[97039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5
Sep 30 17:58:09 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:09 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" returned: 0 in 0.513s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:09 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:58:09 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-0d9c9cb4-24e1-404a-86fd-c8241d183c20 req-f8270498-78fb-49f4-a1e7-aa7b25d11303 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-0d9c9cb4-24e1-404a-86fd-c8241d183c20 req-f8270498-78fb-49f4-a1e7-aa7b25d11303 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-0d9c9cb4-24e1-404a-86fd-c8241d183c20 req-f8270498-78fb-49f4-a1e7-aa7b25d11303 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-0d9c9cb4-24e1-404a-86fd-c8241d183c20 req-f8270498-78fb-49f4-a1e7-aa7b25d11303 tempest-AttachVolumeNegativeTest-914970347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-153bd166-92da-431c-94ea-5bba880fb897', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cb72d15-3fc2-4f36-b70f-18eec5afe472', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:58:10 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.604s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:10 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0
Sep 30 17:58:10 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-0d9c9cb4-24e1-404a-86fd-c8241d183c20 req-f8270498-78fb-49f4-a1e7-aa7b25d11303 tempest-AttachVolumeNegativeTest-914970347 None] attachment_update completed successfully.
Sep 30 17:58:10 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5.4a4cf0a1-36aa-4268-aba0-462539cd05f0" returned: 0 in 0.482s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-4a4cf0a1-36aa-4268-aba0-462539cd05f0" released by "_delete_snapshot" :: held 2.245s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" released by "delete_snapshot" :: held 2.293s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Created reservations ['f5312bc6-cc19-4bc6-b5ff-902ab0ca970e', 'e784e221-eee9-4ced-9beb-f155de83dc5c', 'a75df369-9788-4ac0-97fe-32bc5377e6fa', 'b87d3481-8ef8-44e8-a647-9a94d20c5b04'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Delete snapshot completed successfully.
Sep 30 17:58:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dff0ef2f-4ee6-4604-a7a1-fc1b7ba98dd0 tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-4a4cf0a1-36aa-4268-aba0-462539cd05f0-delete_snapshot" released by "delete_snapshot" :: held 2.564s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-b0e03e08-c423-4ca6-8687-ccc4d86dfed5-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-b0e03e08-c423-4ca6-8687-ccc4d86dfed5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:12 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[720539ae-c6ba-4afe-a3fd-5fdfce9050e7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:12 devstack sudo[97079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5
Sep 30 17:58:12 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:12 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" returned: 0 in 0.594s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:12 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5
Sep 30 17:58:12 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:13 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" returned: 0 in 0.423s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-quobyte-b0e03e08-c423-4ca6-8687-ccc4d86dfed5" released by "delete_volume" :: held 1.153s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Created reservations ['822e1992-cd0c-4d11-8bbf-5c266544e3e2', '744235e9-2c96-49ef-a0ac-8cbe561a4e17', 'c83ec7b5-e67a-4410-a679-2c98d8ae2f6c', '63fa94ae-14c6-4361-bcd8-c38b958620c0'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:13 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:13 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-e11b7dc3-9b25-45ed-ace9-19932801c1af req-8daa067b-1447-425a-b6c8-9586c87efc56 tempest-AttachVolumeNegativeTest-914970347 None] Terminate volume connection completed successfully.
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-e11b7dc3-9b25-45ed-ace9-19932801c1af req-8daa067b-1447-425a-b6c8-9586c87efc56 tempest-AttachVolumeNegativeTest-914970347 None] Deleting attachment 3cb72d15-3fc2-4f36-b70f-18eec5afe472. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:58:13 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.289s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Deleted volume successfully.
Sep 30 17:58:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-14337354-e293-4d4f-bce4-3c06df0cd55f tempest-VolumesSnapshotListTestJSON-101990410 None] Lock "cinder-b0e03e08-c423-4ca6-8687-ccc4d86dfed5-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "cinder-153bd166-92da-431c-94ea-5bba880fb897-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-153bd166-92da-431c-94ea-5bba880fb897-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "cinder-quobyte-153bd166-92da-431c-94ea-5bba880fb897" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-quobyte-153bd166-92da-431c-94ea-5bba880fb897" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:19 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ccd57-4357-4d9d-bdf4-893a0093e19e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:19 devstack sudo[97126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897
Sep 30 17:58:19 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:20 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897" returned: 0 in 0.534s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:20 devstack sudo[97131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897
Sep 30 17:58:20 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:20 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-153bd166-92da-431c-94ea-5bba880fb897" returned: 0 in 0.343s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-quobyte-153bd166-92da-431c-94ea-5bba880fb897" released by "delete_volume" :: held 0.954s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Flow 'volume_create_manager' (adc28f8a-6934-477d-96b8-009071787c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68efa07a-c078-4dfb-9e5e-7ce19e939b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68efa07a-c078-4dfb-9e5e-7ce19e939b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1982637536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfe7e92-8016-4174-91c5-7f66eef45caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a65a64cbe43436fabe9663fb483ffe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:20Z,use_quota=True,user_id='636140d489c94ec387a648c20cc8ebba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a6761e-5d58-4609-9048-247f52d919d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a6761e-5d58-4609-9048-247f52d919d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38486fc4-0117-4f53-912a-4d746a1823c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38486fc4-0117-4f53-912a-4d746a1823c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfe7e92-8016-4174-91c5-7f66eef45caa', 'volume_name': 'volume-cdfe7e92-8016-4174-91c5-7f66eef45caa', 'volume_size': 2}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da41f3d7-328d-45d9-9df3-2a716cd199ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da41f3d7-328d-45d9-9df3-2a716cd199ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aee0d2-be39-4a38-b47c-48c584e63fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Volume cdfe7e92-8016-4174-91c5-7f66eef45caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfe7e92-8016-4174-91c5-7f66eef45caa', 'volume_size': 2}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1982637536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfe7e92-8016-4174-91c5-7f66eef45caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a65a64cbe43436fabe9663fb483ffe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:20Z,use_quota=True,user_id='636140d489c94ec387a648c20cc8ebba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Creating volume cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:20 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa 2147483648 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Created reservations ['ecb27628-621f-4a6b-bc80-cbf79e594677', 'a50d8c3d-4876-461b-889c-5cee5ab61588', '2658f0e5-9639-43b0-818f-9b694b35fe99', '0ff42404-48b0-4172-8f9e-37de037ac653'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:20 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa 2147483648
Sep 30 17:58:20 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:20 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:20 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:21 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.335s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Deleted volume successfully.
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c42f5d8e-9ca3-43e3-b66b-dc2f2f194b59 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-153bd166-92da-431c-94ea-5bba880fb897-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:21 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa 2147483648" returned: 0 in 0.643s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:21 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa
Sep 30 17:58:21 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:21 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa" returned: 0 in 0.326s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aee0d2-be39-4a38-b47c-48c584e63fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfe7e92-8016-4174-91c5-7f66eef45caa', 'volume_size': 2}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b82d72-6238-4f99-9518-43afb82726d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Volume volume-cdfe7e92-8016-4174-91c5-7f66eef45caa (cdfe7e92-8016-4174-91c5-7f66eef45caa): created successfully
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b82d72-6238-4f99-9518-43afb82726d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Flow 'volume_create_manager' (adc28f8a-6934-477d-96b8-009071787c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "cinder-37fc9bc2-2d4d-467f-89d5-9bd81625b258-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3e9674e2-cf06-4447-b03e-8df9cb053f1d tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Created volume successfully.
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-37fc9bc2-2d4d-467f-89d5-9bd81625b258-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "cinder-quobyte-37fc9bc2-2d4d-467f-89d5-9bd81625b258" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-quobyte-37fc9bc2-2d4d-467f-89d5-9bd81625b258" acquired by "delete_volume" :: waited 0.013s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[454c6578-5989-4a07-a016-2ada84a59127]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:22 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258
Sep 30 17:58:22 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:22 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258" returned: 0 in 0.383s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:22 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258
Sep 30 17:58:22 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:22 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37fc9bc2-2d4d-467f-89d5-9bd81625b258" returned: 0 in 0.276s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-quobyte-37fc9bc2-2d4d-467f-89d5-9bd81625b258" released by "delete_volume" :: held 0.709s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Created reservations ['68e0f420-f020-4cd3-a71f-3ff8d09dec9e', '213b8424-5664-487b-95ed-eb0d9c783422', 'd1651e7d-6cf5-43f0-ab5c-394e0561cc19', '477044b0-1c77-47fe-ac04-6c12f293bf28'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:22 devstack sudo[97158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:22 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Creating offline snapshot e6f51863-e825-4b63-9d44-1565775d0e79 of volume cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf7aa0-9fb6-4565-acdc-52b1c27cb231]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:23 devstack sudo[97163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa
Sep 30 17:58:23 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:23 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.489s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Deleted volume successfully.
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "cinder-5dbd416c-18e8-4875-9133-f81fef011029-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e73333c3-5cb1-4b78-ba85-5617644528d6 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-37fc9bc2-2d4d-467f-89d5-9bd81625b258-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-5dbd416c-18e8-4875-9133-f81fef011029-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "cinder-quobyte-5dbd416c-18e8-4875-9133-f81fef011029" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-quobyte-5dbd416c-18e8-4875-9133-f81fef011029" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[066a00ef-9527-4291-8817-6db88571b20f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:23 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa" returned: 0 in 0.561s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 2G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:23 devstack sudo[97169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029
Sep 30 17:58:23 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:23 devstack sudo[97170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 2G
Sep 30 17:58:23 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:24 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029" returned: 0 in 0.483s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:24 devstack sudo[97179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029
Sep 30 17:58:24 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:24 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 2G" returned: 0 in 0.581s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfe7e92-8016-4174-91c5-7f66eef45caa -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:24 devstack sudo[97182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfe7e92-8016-4174-91c5-7f66eef45caa -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79
Sep 30 17:58:24 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:24 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5dbd416c-18e8-4875-9133-f81fef011029" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-quobyte-5dbd416c-18e8-4875-9133-f81fef011029" released by "delete_volume" :: held 0.824s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Created reservations ['ad0d1ffe-cd9e-4f4b-b01f-6fdd16d53886', '6f1a91f6-b8f0-4b76-83e0-0d388c96b8f8', '1e9d8897-c2b5-490b-9f15-8c6041d8cf91', 'cbccee80-a0e9-46c4-8662-2ac4bb7673b5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:24 devstack sudo[97187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:24 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:24 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfe7e92-8016-4174-91c5-7f66eef45caa -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79" returned: 0 in 0.359s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:24 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 is being set with open permissions: ugo+rw
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:24 devstack sudo[97190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79
Sep 30 17:58:24 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:24 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.298s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Deleted volume successfully.
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0204fdd2-ebcb-466b-b9b9-2ed1a451e8d9 tempest-AttachVolumeNegativeTest-914970347 None] Lock "cinder-5dbd416c-18e8-4875-9133-f81fef011029-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:24 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79" returned: 0 in 0.303s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:24 devstack sudo[97194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info
Sep 30 17:58:24 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:25 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info" returned: 0 in 0.278s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:25 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info is being set with open permissions: ugo+rw
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:25 devstack sudo[97197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info
Sep 30 17:58:25 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:25 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.info" returned: 0 in 0.288s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-bf848e1e-a017-4880-801e-710f07027564 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Create snapshot completed successfully
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Flow 'volume_create_manager' (0441f455-7aa7-4214-97a7-7dcc3db905da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee987288-0728-48ce-b905-7ddde66b29a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee987288-0728-48ce-b905-7ddde66b29a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-198952826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747302b1-e175-4832-b0e1-c430688104b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5c6d5245c54bbaacad2fe3eac4531c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:26Z,use_quota=True,user_id='f40d7eeba75c4d55b7fa18dc87d22cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6b2c18-e5ae-45c4-879f-c434a94fa87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6b2c18-e5ae-45c4-879f-c434a94fa87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae2afb8-dedb-483a-ae4f-39f420812624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae2afb8-dedb-483a-ae4f-39f420812624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747302b1-e175-4832-b0e1-c430688104b4', 'volume_name': 'volume-747302b1-e175-4832-b0e1-c430688104b4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3711cf95-e440-4903-a916-b82d7849be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3711cf95-e440-4903-a916-b82d7849be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cdfbf28-a904-4913-a2dd-8d46cbc69a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:25 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Volume 747302b1-e175-4832-b0e1-c430688104b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747302b1-e175-4832-b0e1-c430688104b4', 'volume_size': 1}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-198952826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747302b1-e175-4832-b0e1-c430688104b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5c6d5245c54bbaacad2fe3eac4531c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:26Z,use_quota=True,user_id='f40d7eeba75c4d55b7fa18dc87d22cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Creating volume 747302b1-e175-4832-b0e1-c430688104b4 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:25 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:25 devstack sudo[97201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4 1073741824
Sep 30 17:58:25 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "cinder-e6f51863-e825-4b63-9d44-1565775d0e79-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-e6f51863-e825-4b63-9d44-1565775d0e79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "cinder-quobyte-cdfe7e92-8016-4174-91c5-7f66eef45caa" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-quobyte-cdfe7e92-8016-4174-91c5-7f66eef45caa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "cinder-quobyte-e6f51863-e825-4b63-9d44-1565775d0e79" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-quobyte-e6f51863-e825-4b63-9d44-1565775d0e79" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Deleting offline snapshot e6f51863-e825-4b63-9d44-1565775d0e79 of volume cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:58:26 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] snapshot_file for this snap is: volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4 1073741824" returned: 0 in 0.539s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c70c40a-3525-4270-9784-8ccbf9a997a7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:26 devstack sudo[97233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4
Sep 30 17:58:26 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:26 devstack sudo[97232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79
Sep 30 17:58:26 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:26 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4" returned: 0 in 0.271s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cdfbf28-a904-4913-a2dd-8d46cbc69a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747302b1-e175-4832-b0e1-c430688104b4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cd4a10-e2c3-4f04-bcac-272bba2a58e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Volume volume-747302b1-e175-4832-b0e1-c430688104b4 (747302b1-e175-4832-b0e1-c430688104b4): created successfully
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cd4a10-e2c3-4f04-bcac-272bba2a58e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Flow 'volume_create_manager' (0441f455-7aa7-4214-97a7-7dcc3db905da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-141b64f9-c264-42c6-8177-a1f427cfd04c tempest-VolumesTransfersV355Test-687808513 None] Created volume successfully.
Sep 30 17:58:26 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79" returned: 0 in 0.422s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfe7e92-8016-4174-91c5-7f66eef45caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffdef0d-1632-4710-adc2-a331662c426c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:26 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa
Sep 30 17:58:26 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:27 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:27 devstack sudo[97245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79
Sep 30 17:58:27 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:27 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79" returned: 0 in 0.324s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:27 devstack sudo[97250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79
Sep 30 17:58:27 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:27 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa.e6f51863-e825-4b63-9d44-1565775d0e79" returned: 0 in 0.253s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-quobyte-e6f51863-e825-4b63-9d44-1565775d0e79" released by "_delete_snapshot" :: held 1.525s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-quobyte-cdfe7e92-8016-4174-91c5-7f66eef45caa" released by "delete_snapshot" :: held 1.562s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:27 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Created reservations ['d6802f2a-4eb6-4005-b3ec-1c65d8bee78f', 'ea3afc69-bafb-4a95-8134-1f5f9257f3dd', '3df4acca-e261-43d3-ab1a-39eace667561', 'd7ad1de3-3a4e-4eda-9db6-51494c1b8f49'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Delete snapshot completed successfully.
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef5de6b6-bb5c-4d0d-8a39-7d5992c1f381 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-e6f51863-e825-4b63-9d44-1565775d0e79-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "cinder-cdfe7e92-8016-4174-91c5-7f66eef45caa-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-cdfe7e92-8016-4174-91c5-7f66eef45caa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "cinder-quobyte-cdfe7e92-8016-4174-91c5-7f66eef45caa" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-quobyte-cdfe7e92-8016-4174-91c5-7f66eef45caa" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-30226cda-6c81-4c27-93e0-f7951faa9111 tempest-VolumesTransfersV355Test-1337615795 None] Transfer volume completed successfully.
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70cd5a7-6475-4457-b451-5ca1b2f5080d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:28 devstack sudo[97253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa
Sep 30 17:58:28 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:29 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa" returned: 0 in 0.458s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:29 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa
Sep 30 17:58:29 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Acquiring lock "cinder-747302b1-e175-4832-b0e1-c430688104b4-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-747302b1-e175-4832-b0e1-c430688104b4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=116,cinder:INSERT=26,cinder:SELECT=95,cinder:DELETE=6 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=115,cinder:SELECT=115,cinder:DELETE=13,cinder:INSERT=32 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:58:29 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cdfe7e92-8016-4174-91c5-7f66eef45caa" returned: 0 in 0.314s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Acquiring lock "cinder-quobyte-747302b1-e175-4832-b0e1-c430688104b4" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-quobyte-cdfe7e92-8016-4174-91c5-7f66eef45caa" released by "delete_volume" :: held 0.859s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-quobyte-747302b1-e175-4832-b0e1-c430688104b4" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc479e1a-e8f5-40fc-a195-36e3e33fdc25]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Created reservations ['d7b1ab1b-93c6-4304-af63-09eb9ce3ad56', '42d6a84e-31d3-4126-87ce-b5eb3ef5a683', '6353542c-a0fc-4828-b150-85e04dc94b3b', '171a952f-26c1-45c9-a53f-71a7f76f43a6'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:29 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4
Sep 30 17:58:29 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:29 devstack sudo[97263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:29 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:29 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.279s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Deleted volume successfully.
Sep 30 17:58:29 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4" returned: 0 in 0.433s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:29 devstack sudo[97271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4
Sep 30 17:58:29 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-92d7e379-442d-4981-8ace-5714676cb698 tempest-VolumesSnapshotNegativeTestJSON-560220505 None] Lock "cinder-cdfe7e92-8016-4174-91c5-7f66eef45caa-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:30 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-747302b1-e175-4832-b0e1-c430688104b4" returned: 0 in 0.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-quobyte-747302b1-e175-4832-b0e1-c430688104b4" released by "delete_volume" :: held 0.749s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Created reservations ['b0b4328f-358d-436d-983a-046498dd39c6', '92763377-6635-444f-9d80-7ed8c29a08d2', 'dec128f7-3a07-48bd-afe0-0872552ad724', '39f924fb-17e7-40e1-83e0-b3e26457fac4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:30 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:30 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:30 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.291s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Deleted volume successfully.
Sep 30 17:58:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c99dd67e-7e91-4b51-a13c-873b2a99a0d9 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-747302b1-e175-4832-b0e1-c430688104b4-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Flow 'volume_create_manager' (99e12af6-9bdd-4db8-a613-1bf4ae536ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642d3f1f-c251-4c50-a052-11ad4c4a703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642d3f1f-c251-4c50-a052-11ad4c4a703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1843379257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bcb190-402d-4562-ac2c-b18001cf9e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5c6d5245c54bbaacad2fe3eac4531c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:31Z,use_quota=True,user_id='f40d7eeba75c4d55b7fa18dc87d22cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32ef3b8-c72a-4b4b-b253-f80d8dd0354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32ef3b8-c72a-4b4b-b253-f80d8dd0354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128abc15-9000-4ed0-a9af-f4ef60ee08c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128abc15-9000-4ed0-a9af-f4ef60ee08c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bcb190-402d-4562-ac2c-b18001cf9e6c', 'volume_name': 'volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ced67c-48ac-4b72-abc2-76962b597a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ced67c-48ac-4b72-abc2-76962b597a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0332767e-ca0e-4a22-b048-cc35ce792547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Volume d2bcb190-402d-4562-ac2c-b18001cf9e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c', 'volume_size': 1}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1843379257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bcb190-402d-4562-ac2c-b18001cf9e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5c6d5245c54bbaacad2fe3eac4531c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:31Z,use_quota=True,user_id='f40d7eeba75c4d55b7fa18dc87d22cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Creating volume d2bcb190-402d-4562-ac2c-b18001cf9e6c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:31 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:31 devstack sudo[97278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c 1073741824
Sep 30 17:58:31 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:32 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c 1073741824" returned: 0 in 0.684s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:32 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c
Sep 30 17:58:32 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:32 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c" returned: 0 in 0.305s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0332767e-ca0e-4a22-b048-cc35ce792547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5f9440-a169-4252-b298-8aa9a1f3d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:32 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Volume volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c (d2bcb190-402d-4562-ac2c-b18001cf9e6c): created successfully
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5f9440-a169-4252-b298-8aa9a1f3d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Flow 'volume_create_manager' (99e12af6-9bdd-4db8-a613-1bf4ae536ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-30c353da-2e4f-49cc-980f-de89f6ddfc22 tempest-VolumesTransfersV355Test-687808513 None] Created volume successfully.
Sep 30 17:58:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-f77ef361-c0cb-4e5c-b170-90e959bb7483 req-12d01c8e-fbc6-445b-b72d-942847060fdb tempest-AttachVolumeTestJSON-1438487512 None] Terminate volume connection completed successfully.
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-f77ef361-c0cb-4e5c-b170-90e959bb7483 req-12d01c8e-fbc6-445b-b72d-942847060fdb tempest-AttachVolumeTestJSON-1438487512 None] Deleting attachment a10796f9-362c-4238-9a06-42deb0f2e92e. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Flow 'volume_create_manager' (654d4e65-5aa6-4bf2-bb20-5ed3916238a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa98574-7257-47b5-a6d7-d22edb5fd6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Acquiring lock "cinder-d2bcb190-402d-4562-ac2c-b18001cf9e6c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa98574-7257-47b5-a6d7-d22edb5fd6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-975391551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d81a70117b640e1ac557727a70769c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:34Z,use_quota=True,user_id='fd143d81625b45a1a98562f15365b1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e264b3-f490-4128-8808-908de379f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e264b3-f490-4128-8808-908de379f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5f8de7-bb65-40f0-957c-748f3adcb42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5f8de7-bb65-40f0-957c-748f3adcb42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9', 'volume_name': 'volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46827e87-790a-407a-96e6-f65c26344295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46827e87-790a-407a-96e6-f65c26344295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2578a90b-f711-4435-bce1-94f1f0e3d4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Volume 7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9', 'volume_size': 1}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-975391551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d81a70117b640e1ac557727a70769c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:34Z,use_quota=True,user_id='fd143d81625b45a1a98562f15365b1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Creating volume 7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:34 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-d2bcb190-402d-4562-ac2c-b18001cf9e6c-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:34 devstack sudo[97297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 1073741824
Sep 30 17:58:34 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Acquiring lock "cinder-quobyte-d2bcb190-402d-4562-ac2c-b18001cf9e6c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-quobyte-d2bcb190-402d-4562-ac2c-b18001cf9e6c" acquired by "delete_volume" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c33646b-fe72-43a6-a27f-0412694895b2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:34 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c
Sep 30 17:58:34 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:34 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 1073741824" returned: 0 in 0.568s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:34 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c" returned: 0 in 0.491s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:34 devstack sudo[97314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9
Sep 30 17:58:34 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:34 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c
Sep 30 17:58:34 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:35 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:35 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" returned: 0 in 0.349s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2bcb190-402d-4562-ac2c-b18001cf9e6c" returned: 0 in 0.324s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2578a90b-f711-4435-bce1-94f1f0e3d4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1b65cd-22c7-484a-96f8-48a7db0b3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-quobyte-d2bcb190-402d-4562-ac2c-b18001cf9e6c" released by "delete_volume" :: held 0.901s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Volume volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 (7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9): created successfully
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1b65cd-22c7-484a-96f8-48a7db0b3109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Flow 'volume_create_manager' (654d4e65-5aa6-4bf2-bb20-5ed3916238a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-1aad0e84-194d-4ac5-a34a-177ae72b544f req-30a7b3c3-350f-434a-a128-ac456175b2c6 tempest-VolumesSnapshotsTestJSON-945686147 None] Created volume successfully.
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Created reservations ['7ef3fc2e-63d8-48af-9d1c-50d36358d313', '26231daf-220b-41e5-9da9-66eb03f020b0', '79c23a2a-59ac-467b-8cfe-d1220848b24f', '08ce7bf6-3feb-473e-9203-6670137071a2'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:35 devstack sudo[97320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:35 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:35 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Deleted volume successfully.
Sep 30 17:58:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f47514cc-9b7f-4d61-b9e6-f41caa1aa252 tempest-VolumesTransfersV355Test-304640834 None] Lock "cinder-d2bcb190-402d-4562-ac2c-b18001cf9e6c-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Creating offline snapshot 629762e3-ddf3-4cf4-b856-2ed5ea79145c of volume 7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:58:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d6b079-b12e-49a6-b3d7-6af65c51872d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:36 devstack sudo[97324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9
Sep 30 17:58:36 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:37 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" returned: 0 in 0.719s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:37 devstack sudo[97344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c 1G
Sep 30 17:58:37 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:37 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c 1G" returned: 0 in 0.679s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:37 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c
Sep 30 17:58:37 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:38 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c" returned: 0 in 0.470s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c is being set with open permissions: ugo+rw
Sep 30 17:58:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:38 devstack sudo[97390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c
Sep 30 17:58:38 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:38 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c" returned: 0 in 0.322s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:38 devstack sudo[97415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info
Sep 30 17:58:38 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:39 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info" returned: 0 in 0.459s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:39 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info is being set with open permissions: ugo+rw
Sep 30 17:58:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:39 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info
Sep 30 17:58:39 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:39 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.info" returned: 0 in 0.338s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.149s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-b7b9cbce-85d8-4cf0-8fb4-ecaea0898f14 req-0b06ddd6-c9ed-4fa1-8888-b125125921f6 tempest-VolumesSnapshotsTestJSON-945686147 None] Create snapshot completed successfully
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "cinder-629762e3-ddf3-4cf4-b856-2ed5ea79145c-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-629762e3-ddf3-4cf4-b856-2ed5ea79145c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "cinder-quobyte-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-quobyte-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "cinder-quobyte-629762e3-ddf3-4cf4-b856-2ed5ea79145c" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-quobyte-629762e3-ddf3-4cf4-b856-2ed5ea79145c" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Deleting offline snapshot 629762e3-ddf3-4cf4-b856-2ed5ea79145c of volume 7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] snapshot_file for this snap is: volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15495e-9c8b-49ba-8b8d-2461a9dbed21]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:41 devstack sudo[97478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c
Sep 30 17:58:41 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:41 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c" returned: 0 in 0.704s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd59c35-62bb-44bb-8b2b-7f7161ea5e80]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:42 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9
Sep 30 17:58:42 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:42 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" returned: 0 in 0.694s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:42 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c
Sep 30 17:58:42 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:43 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c" returned: 0 in 0.651s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:43 devstack sudo[97531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c
Sep 30 17:58:43 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:43 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9.629762e3-ddf3-4cf4-b856-2ed5ea79145c" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-quobyte-629762e3-ddf3-4cf4-b856-2ed5ea79145c" released by "_delete_snapshot" :: held 2.770s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-quobyte-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" released by "delete_snapshot" :: held 2.843s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG cinder.quota [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Created reservations ['384365ad-bf8e-481c-ba01-bca9a357c910', '0fcf08eb-46b6-41c2-89bc-6c300ab57f6f', '18ebaffe-a33d-47e4-ac46-9100f88b7a4d', '9fe9d427-42e0-40d4-afbf-92717ed0e05f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:43 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Delete snapshot completed successfully.
Sep 30 17:58:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-4236c82d-a8fb-4bb9-9eff-756c0baab699 req-badaa01b-0a2f-420b-a505-68e08350d331 tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-629762e3-ddf3-4cf4-b856-2ed5ea79145c-delete_snapshot" released by "delete_snapshot" :: held 3.088s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "cinder-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "cinder-quobyte-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-quobyte-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[625a013b-ec41-4b9e-9787-f7d296e5431a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:44 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9
Sep 30 17:58:44 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:45 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" returned: 0 in 0.545s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:45 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9
Sep 30 17:58:45 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:45 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" returned: 0 in 0.395s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-quobyte-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9" released by "delete_volume" :: held 1.117s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG cinder.quota [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Created reservations ['3fe86e94-33b2-4852-b99e-2d72eec55d00', 'ef1f7f9a-7181-4030-8eaf-ea49f0b10502', '6bbe63e9-3e2b-4fc2-a623-e473a9098251', 'f12d6f27-aa3a-41be-890c-d3aec03740f1'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:46 devstack sudo[97543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:46 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:46 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:46 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:46 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.524s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.manager [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:46 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Deleted volume successfully.
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-14d4e0ea-742a-4399-ab1e-fa44f740d989 req-dc3c0b23-0ee8-4b35-879a-92985775d48f tempest-VolumesSnapshotsTestJSON-945686147 None] Lock "cinder-7a871ed8-dee4-4a4b-b05f-8eb7b090e4f9-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:46 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.485s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:58:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (e2684177-ca87-42a7-af98-fd37b12b8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410baca5-937c-4bc0-b69f-15fbbf43da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410baca5-937c-4bc0-b69f-15fbbf43da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68816902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7634e555-abd8-4eaa-b451-39cfcfa91f80,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:48Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83675da3-af0b-4f66-af2e-8df63927eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83675da3-af0b-4f66-af2e-8df63927eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e444cdca-897f-414b-b6a5-b7d74893f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e444cdca-897f-414b-b6a5-b7d74893f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7634e555-abd8-4eaa-b451-39cfcfa91f80', 'volume_name': 'volume-7634e555-abd8-4eaa-b451-39cfcfa91f80', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5752a3-305b-4362-8f75-ee994563bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5752a3-305b-4362-8f75-ee994563bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88295446-8e10-4a58-beb3-8b52d9e582ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Volume 7634e555-abd8-4eaa-b451-39cfcfa91f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7634e555-abd8-4eaa-b451-39cfcfa91f80', 'volume_size': 1}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68816902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7634e555-abd8-4eaa-b451-39cfcfa91f80,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:48Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Creating volume 7634e555-abd8-4eaa-b451-39cfcfa91f80 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:48 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:48 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 1073741824
Sep 30 17:58:48 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:49 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 1073741824" returned: 0 in 0.800s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:49 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80
Sep 30 17:58:49 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:49 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80" returned: 0 in 0.312s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88295446-8e10-4a58-beb3-8b52d9e582ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7634e555-abd8-4eaa-b451-39cfcfa91f80', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63342cd7-07a4-447c-9ef1-d4a86bbae159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:49 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Volume volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 (7634e555-abd8-4eaa-b451-39cfcfa91f80): created successfully
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63342cd7-07a4-447c-9ef1-d4a86bbae159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (e2684177-ca87-42a7-af98-fd37b12b8a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:49 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-155c3ccb-84cc-45a5-a374-d04c84827438 tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:58:51 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (6b046519-bf9b-4d11-93d5-1d6a91fed0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2d4ce1-9ce4-4d2a-b854-6fedd317c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2d4ce1-9ce4-4d2a-b854-6fedd317c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-374312030',display_name='tempest-VolumesGetTest-Volume-224767787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82819af2-9279-47a0-b0c6-1daf333e3c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:52Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9accab-0640-464c-af1f-d6df95e58844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9accab-0640-464c-af1f-d6df95e58844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df2f05e-90dd-4527-bc34-7b8cb61dbb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df2f05e-90dd-4527-bc34-7b8cb61dbb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82819af2-9279-47a0-b0c6-1daf333e3c7e', 'volume_name': 'volume-82819af2-9279-47a0-b0c6-1daf333e3c7e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3155afd9-7cb8-4cc9-a604-66a9b7f0354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3155afd9-7cb8-4cc9-a604-66a9b7f0354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774a0329-5578-4802-ad7f-723393891a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:52 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Volume 82819af2-9279-47a0-b0c6-1daf333e3c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82819af2-9279-47a0-b0c6-1daf333e3c7e', 'volume_size': 1}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-374312030',display_name='tempest-VolumesGetTest-Volume-224767787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82819af2-9279-47a0-b0c6-1daf333e3c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:52Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Creating volume 82819af2-9279-47a0-b0c6-1daf333e3c7e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:52 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:52 devstack sudo[97559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e 1073741824
Sep 30 17:58:52 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:52 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e 1073741824" returned: 0 in 0.616s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:52 devstack sudo[97565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e
Sep 30 17:58:52 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:53 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774a0329-5578-4802-ad7f-723393891a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82819af2-9279-47a0-b0c6-1daf333e3c7e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fd7a9a-6e11-42a7-b77d-2dd0a8238ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:53 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Volume volume-82819af2-9279-47a0-b0c6-1daf333e3c7e (82819af2-9279-47a0-b0c6-1daf333e3c7e): created successfully
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fd7a9a-6e11-42a7-b77d-2dd0a8238ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (6b046519-bf9b-4d11-93d5-1d6a91fed0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:53 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8cfd781e-408f-420d-b8f7-feae239933ee tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-82819af2-9279-47a0-b0c6-1daf333e3c7e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Lock "cinder-82819af2-9279-47a0-b0c6-1daf333e3c7e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-82819af2-9279-47a0-b0c6-1daf333e3c7e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-82819af2-9279-47a0-b0c6-1daf333e3c7e" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c401c-3fb1-40b4-adac-ceeaafd56e1f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:54 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e
Sep 30 17:58:54 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Flow 'volume_create_manager' (8f4593af-17db-4199-945e-43c7eda4e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55cc8fa7-256f-4df2-88f9-37aa631c9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55cc8fa7-256f-4df2-88f9-37aa631c9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1113102378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdddca5-490b-44cc-baa2-51073c639913,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19ab7a94623640819859ca91de237718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:54Z,use_quota=True,user_id='77ea52baaded462aad25213a2ab2ac1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05a9438-493f-4b2b-a635-3533bfe910ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05a9438-493f-4b2b-a635-3533bfe910ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86ea8c7-64c2-43b6-94e8-40ab0cfa180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86ea8c7-64c2-43b6-94e8-40ab0cfa180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfdddca5-490b-44cc-baa2-51073c639913', 'volume_name': 'volume-bfdddca5-490b-44cc-baa2-51073c639913', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cac3cb-5337-4b73-a8ee-a68d8a19b42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cac3cb-5337-4b73-a8ee-a68d8a19b42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03d6ba3-16d7-4fb4-9f20-26f9d734734b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Volume bfdddca5-490b-44cc-baa2-51073c639913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfdddca5-490b-44cc-baa2-51073c639913', 'volume_size': 1}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1113102378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdddca5-490b-44cc-baa2-51073c639913,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19ab7a94623640819859ca91de237718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:54Z,use_quota=True,user_id='77ea52baaded462aad25213a2ab2ac1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Creating volume bfdddca5-490b-44cc-baa2-51073c639913 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:54 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:54 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913 1073741824
Sep 30 17:58:54 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:54 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:54 devstack sudo[97577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e
Sep 30 17:58:54 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:55 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-82819af2-9279-47a0-b0c6-1daf333e3c7e" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-82819af2-9279-47a0-b0c6-1daf333e3c7e" released by "delete_volume" :: held 0.727s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Created reservations ['ec06877e-c3bd-4ea0-864c-e7cc88207f1f', '9b0ea6f8-6049-43e5-be9d-09dce034dd8f', '6fa24223-4979-48a2-902f-c74384a93057', '295e4ee6-3b16-458e-87df-6a2023d01f9f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:55 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913 1073741824" returned: 0 in 0.510s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:55 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:55 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:55 devstack sudo[97585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913
Sep 30 17:58:55 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:55 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.340s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:58:55 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fce76469-e5da-4048-a5a4-53b99bef991c tempest-VolumesGetTest-1505307289 None] Lock "cinder-82819af2-9279-47a0-b0c6-1daf333e3c7e-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-7634e555-abd8-4eaa-b451-39cfcfa91f80-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913" returned: 0 in 0.457s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Lock "cinder-7634e555-abd8-4eaa-b451-39cfcfa91f80-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03d6ba3-16d7-4fb4-9f20-26f9d734734b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdddca5-490b-44cc-baa2-51073c639913', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f148838-36e8-4417-8201-ac327b08d226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Volume volume-bfdddca5-490b-44cc-baa2-51073c639913 (bfdddca5-490b-44cc-baa2-51073c639913): created successfully
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f148838-36e8-4417-8201-ac327b08d226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Flow 'volume_create_manager' (8f4593af-17db-4199-945e-43c7eda4e19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-7634e555-abd8-4eaa-b451-39cfcfa91f80" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:58:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5d7b485a-f01d-46b1-af41-354ead43b8ff tempest-VolumesTestJSON-1491892028 None] Created volume successfully.
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-7634e555-abd8-4eaa-b451-39cfcfa91f80" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd9ff1c-bb00-406b-8319-f9aa50fef8c6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:58:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:55 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80
Sep 30 17:58:55 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:56 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:56 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80
Sep 30 17:58:56 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:56 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7634e555-abd8-4eaa-b451-39cfcfa91f80" returned: 0 in 0.278s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-7634e555-abd8-4eaa-b451-39cfcfa91f80" released by "delete_volume" :: held 0.752s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Created reservations ['64e3da30-f83a-4556-848b-ccef64af8275', '408eab75-2ccb-431a-a42b-df8b3590bdb0', 'b2981726-8aca-4a4a-8f60-a542c3165bb8', 'a6e450ce-a521-4dc0-824e-958b65dc0a44'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:56 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:58:56 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:56 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.321s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:58:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-35204c92-a8f8-41ae-bc1e-6f5bccec8178 tempest-VolumesGetTest-1505307289 None] Lock "cinder-7634e555-abd8-4eaa-b451-39cfcfa91f80-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Flow 'volume_create_manager' (e133ef65-3a52-4ccd-8c67-3a7c6316a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364341ca-8dc1-443b-b63e-80c61e068449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364341ca-8dc1-443b-b63e-80c61e068449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2019548334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740c57ed-fd94-4155-ae6b-eaca4c06a55e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19ab7a94623640819859ca91de237718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:58Z,use_quota=True,user_id='77ea52baaded462aad25213a2ab2ac1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83aa156-ef3c-48f4-be70-9d9316ce156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83aa156-ef3c-48f4-be70-9d9316ce156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399012a-422e-46f2-8c54-8e9d22e8437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399012a-422e-46f2-8c54-8e9d22e8437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740c57ed-fd94-4155-ae6b-eaca4c06a55e', 'volume_name': 'volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f82184-e4e0-4ba2-a52c-0f746e1c63ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f82184-e4e0-4ba2-a52c-0f746e1c63ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa45c93-85a0-4154-a012-3f40f5c64320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Volume 740c57ed-fd94-4155-ae6b-eaca4c06a55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e', 'volume_size': 1}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2019548334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740c57ed-fd94-4155-ae6b-eaca4c06a55e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19ab7a94623640819859ca91de237718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:58Z,use_quota=True,user_id='77ea52baaded462aad25213a2ab2ac1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Creating volume 740c57ed-fd94-4155-ae6b-eaca4c06a55e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:57 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:58:57 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e 1073741824
Sep 30 17:58:57 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (17dee85a-6897-4dcf-b580-b0bc0ebd706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817d9c95-6e06-467f-8299-c555b3d962d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817d9c95-6e06-467f-8299-c555b3d962d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1371351923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39914174-840a-4e41-be1b-ad0c08af33d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:58Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4b6207-f3c3-462d-9851-0fec6c48b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4b6207-f3c3-462d-9851-0fec6c48b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbefa0d-a2e0-4ea5-ad65-729cd8aeb07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbefa0d-a2e0-4ea5-ad65-729cd8aeb07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39914174-840a-4e41-be1b-ad0c08af33d5', 'volume_name': 'volume-39914174-840a-4e41-be1b-ad0c08af33d5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f59f7f7-45f8-4b0a-9948-e77a84c51236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f59f7f7-45f8-4b0a-9948-e77a84c51236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f938636-fd8b-4895-8ff9-8ef107076554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Volume 39914174-840a-4e41-be1b-ad0c08af33d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39914174-840a-4e41-be1b-ad0c08af33d5', 'volume_size': 1}
Sep 30 17:58:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:58 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e 1073741824" returned: 0 in 0.503s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:58 devstack sudo[97608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e
Sep 30 17:58:58 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:58 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e" returned: 0 in 0.270s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1371351923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39914174-840a-4e41-be1b-ad0c08af33d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:58:58Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Creating volume 39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:58:58 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa45c93-85a0-4154-a012-3f40f5c64320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:58 devstack sudo[97611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 1073741824
Sep 30 17:58:58 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb41ff81-f126-4187-ac0e-d878d73b4e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Volume volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e (740c57ed-fd94-4155-ae6b-eaca4c06a55e): created successfully
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb41ff81-f126-4187-ac0e-d878d73b4e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Flow 'volume_create_manager' (e133ef65-3a52-4ccd-8c67-3a7c6316a277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-bbb9b890-e809-4b19-82b8-ad79306934a0 tempest-VolumesTestJSON-1491892028 None] Created volume successfully.
Sep 30 17:58:59 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 1073741824" returned: 0 in 0.490s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:58:59 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5
Sep 30 17:58:59 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:58:59 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5" returned: 0 in 0.344s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f938636-fd8b-4895-8ff9-8ef107076554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39914174-840a-4e41-be1b-ad0c08af33d5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d61056-8102-4673-a3bd-7d32e5d2a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:58:59 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Volume volume-39914174-840a-4e41-be1b-ad0c08af33d5 (39914174-840a-4e41-be1b-ad0c08af33d5): created successfully
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d61056-8102-4673-a3bd-7d32e5d2a652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:58:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (17dee85a-6897-4dcf-b580-b0bc0ebd706e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:58:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e58b6235-ed56-4b24-bacb-035d898f48ef tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Flow 'volume_create_manager' (1f35d3b4-6e9a-4788-9d14-7dbfc616d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b33c9c2-e3bd-4cbc-bc4b-b7e358847b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b33c9c2-e3bd-4cbc-bc4b-b7e358847b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1060961414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e4c43e-c225-4389-8f1f-7c52b9fb307a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19ab7a94623640819859ca91de237718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:00Z,use_quota=True,user_id='77ea52baaded462aad25213a2ab2ac1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef57ad6-3038-492e-9f0f-7a6f920f488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef57ad6-3038-492e-9f0f-7a6f920f488e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead5bd9-dc47-4441-9ed9-42611f33f33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead5bd9-dc47-4441-9ed9-42611f33f33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e4c43e-c225-4389-8f1f-7c52b9fb307a', 'volume_name': 'volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb100541-1c86-4d1a-831e-fbcbd1049f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb100541-1c86-4d1a-831e-fbcbd1049f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac345d-bff6-4631-8c55-3a07d2d169cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:00 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Volume a0e4c43e-c225-4389-8f1f-7c52b9fb307a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a', 'volume_size': 1}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1060961414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e4c43e-c225-4389-8f1f-7c52b9fb307a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19ab7a94623640819859ca91de237718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:00Z,use_quota=True,user_id='77ea52baaded462aad25213a2ab2ac1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Creating volume a0e4c43e-c225-4389-8f1f-7c52b9fb307a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:00 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:00 devstack sudo[97620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a 1073741824
Sep 30 17:59:00 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:00 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a 1073741824" returned: 0 in 0.576s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:00 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a
Sep 30 17:59:00 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:01 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a" returned: 0 in 0.473s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac345d-bff6-4631-8c55-3a07d2d169cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9deb3bd6-ee9e-468b-912a-77dac0e246a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:01 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Volume volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a (a0e4c43e-c225-4389-8f1f-7c52b9fb307a): created successfully
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9deb3bd6-ee9e-468b-912a-77dac0e246a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Flow 'volume_create_manager' (1f35d3b4-6e9a-4788-9d14-7dbfc616d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-86ffe898-26a8-4fe6-9632-54d4b5171a06 tempest-VolumesTestJSON-1491892028 None] Created volume successfully.
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (cb39df0c-9477-44bf-8dc9-8130833de53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be9ad5f-0f50-49f5-b53f-b49308c644c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be9ad5f-0f50-49f5-b53f-b49308c644c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-387110371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643e875-f08e-4b61-9e44-f3c2e5a2744a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=39914174-840a-4e41-be1b-ad0c08af33d5,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:01Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdcc5ea-5eea-4dc4-88d5-d5abeb07b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdcc5ea-5eea-4dc4-88d5-d5abeb07b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b1b6e7-d1dc-45a0-aece-e6054a8f17ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b1b6e7-d1dc-45a0-aece-e6054a8f17ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9643e875-f08e-4b61-9e44-f3c2e5a2744a', 'volume_name': 'volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a', 'volume_size': 1, 'source_volid': '39914174-840a-4e41-be1b-ad0c08af33d5', 'source_volstatus': 'available'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ab998f-eff9-4c80-b273-13697b6534b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ab998f-eff9-4c80-b273-13697b6534b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f516b30-c35a-46f6-9319-908c14209566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:01 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Volume 9643e875-f08e-4b61-9e44-f3c2e5a2744a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a', 'volume_size': 1, 'source_volid': '39914174-840a-4e41-be1b-ad0c08af33d5', 'source_volstatus': 'available'}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:01 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Cloning volume 39914174-840a-4e41-be1b-ad0c08af33d5 to volume 9643e875-f08e-4b61-9e44-f3c2e5a2744a
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Creating offline snapshot 27f913f7-58da-4430-8e15-1ab258847917 of volume 39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[393adc25-31db-4e6f-a11a-663a57936915]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:01 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5
Sep 30 17:59:01 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:02 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:02 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 1G
Sep 30 17:59:02 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:02 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 1G" returned: 0 in 0.668s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39914174-840a-4e41-be1b-ad0c08af33d5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:02 devstack sudo[97647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39914174-840a-4e41-be1b-ad0c08af33d5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917
Sep 30 17:59:02 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:03 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39914174-840a-4e41-be1b-ad0c08af33d5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917" returned: 0 in 0.655s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:03 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 is being set with open permissions: ugo+rw
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:03 devstack sudo[97674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917
Sep 30 17:59:03 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Acquiring lock "cinder-a0e4c43e-c225-4389-8f1f-7c52b9fb307a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Lock "cinder-a0e4c43e-c225-4389-8f1f-7c52b9fb307a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Acquiring lock "cinder-quobyte-a0e4c43e-c225-4389-8f1f-7c52b9fb307a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Lock "cinder-quobyte-a0e4c43e-c225-4389-8f1f-7c52b9fb307a" acquired by "delete_volume" :: waited 0.013s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2c6b1-36bf-485e-ac89-39b097e2ce46]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:03 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917" returned: 0 in 0.462s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:03 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a
Sep 30 17:59:03 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:03 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info
Sep 30 17:59:03 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:04 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:04 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info" returned: 0 in 0.365s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:04 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info is being set with open permissions: ugo+rw
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a" returned: 0 in 0.554s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:04 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info
Sep 30 17:59:04 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:04 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a
Sep 30 17:59:04 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:04 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.info" returned: 0 in 0.339s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:04 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-9643e875-f08e-4b61-9e44-f3c2e5a2744a" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a0e4c43e-c225-4389-8f1f-7c52b9fb307a" returned: 0 in 0.368s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Lock "cinder-quobyte-a0e4c43e-c225-4389-8f1f-7c52b9fb307a" released by "delete_volume" :: held 1.011s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-9643e875-f08e-4b61-9e44-f3c2e5a2744a" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] snapshot: 27f913f7-58da-4430-8e15-1ab258847917, volume: 9643e875-f08e-4b61-9e44-f3c2e5a2744a,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fba9a8-63c6-407c-b9ba-a225692689fd]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:04 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Created reservations ['03568e88-caed-4a32-8885-17f4ce8cb9dc', '1fb480fb-54e5-4756-a3e4-6574b82208e7', '0ab7fcee-c5df-4179-b824-520b82fdec7d', 'c920171c-6074-4ccb-a760-9a9db76eb56f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:04 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917
Sep 30 17:59:04 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:05 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:05 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:05 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917" returned: 0 in 0.491s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39914174-840a-4e41-be1b-ad0c08af33d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[71861cde-5c55-4c7e-9936-afffb49db96a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:05 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5
Sep 30 17:59:05 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:05 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Flow 'volume_create_manager' (7bbbd5f2-edfa-42ce-b902-9273e4752706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab3a2e-7844-4228-8404-076e6b7b165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.502s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Deleted volume successfully.
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab3a2e-7844-4228-8404-076e6b7b165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-660244678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0276a969-dfde-4f4d-b751-26fca2dddbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d44b58ec8364ea69f2d92ca46ef16b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:05Z,use_quota=True,user_id='411598d776b84b6ea5b938cb66e68f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f35bb4-a691-4886-aa50-bdc2a28da48c),volume_type_id=62f35bb4-a691-4886-aa50-bdc2a28da48c)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a56b4e-39b0-458d-a245-38b01dff240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a56b4e-39b0-458d-a245-38b01dff240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab281745-33df-4be3-9fe2-7310a4fe35bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab281745-33df-4be3-9fe2-7310a4fe35bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0276a969-dfde-4f4d-b751-26fca2dddbd3', 'volume_name': 'volume-0276a969-dfde-4f4d-b751-26fca2dddbd3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68c7098-5b96-4ff5-b691-f7ae0fd1d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68c7098-5b96-4ff5-b691-f7ae0fd1d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbfd59b-61a4-4590-9343-c546cc8a6517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume 0276a969-dfde-4f4d-b751-26fca2dddbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0276a969-dfde-4f4d-b751-26fca2dddbd3', 'volume_size': 1}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-48b787c1-0650-4c63-a98e-865ce9150afb tempest-VolumesTestJSON-1491892028 None] Lock "cinder-a0e4c43e-c225-4389-8f1f-7c52b9fb307a-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:05 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5" returned: 0 in 0.525s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:05 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a
Sep 30 17:59:05 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Acquiring lock "cinder-740c57ed-fd94-4155-ae6b-eaca4c06a55e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Lock "cinder-740c57ed-fd94-4155-ae6b-eaca4c06a55e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Flow 'volume_create_manager' (afd18fa4-0219-472f-b6bd-5207a51f5ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d92acc7-f3db-410b-836a-bac89aa1aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d92acc7-f3db-410b-836a-bac89aa1aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1395814763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e18817-5816-4365-8d29-81ee8c4ebf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d44b58ec8364ea69f2d92ca46ef16b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:06Z,use_quota=True,user_id='411598d776b84b6ea5b938cb66e68f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0efe42c0-c835-4a8d-9330-63f78c3ca2f1),volume_type_id=0efe42c0-c835-4a8d-9330-63f78c3ca2f1)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc599c0d-8039-44ba-a44a-2baf55daf0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc599c0d-8039-44ba-a44a-2baf55daf0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0177e53b-3b32-4b49-a0ea-21ea31150659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0177e53b-3b32-4b49-a0ea-21ea31150659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e18817-5816-4365-8d29-81ee8c4ebf7f', 'volume_name': 'volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2d942f-345b-418c-83c2-e1e1287c22b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2d942f-345b-418c-83c2-e1e1287c22b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e2d2ae-7fee-4d56-a6a6-20eb0bba0353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume b9e18817-5816-4365-8d29-81ee8c4ebf7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f', 'volume_size': 1}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Acquiring lock "cinder-quobyte-740c57ed-fd94-4155-ae6b-eaca4c06a55e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Lock "cinder-quobyte-740c57ed-fd94-4155-ae6b-eaca4c06a55e" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf0e8b1-03bf-4064-9530-a7db1f23713e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:06 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e
Sep 30 17:59:06 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:06 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e" returned: 0 in 0.501s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:06 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e
Sep 30 17:59:06 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:07 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-740c57ed-fd94-4155-ae6b-eaca4c06a55e" returned: 0 in 0.702s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Lock "cinder-quobyte-740c57ed-fd94-4155-ae6b-eaca4c06a55e" released by "delete_volume" :: held 1.303s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Flow 'volume_create_manager' (bade1fb3-bcdb-44aa-8658-6d6a7840ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67dc11fd-2ef5-4ff8-b74e-8c3aa193e5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67dc11fd-2ef5-4ff8-b74e-8c3aa193e5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1366469569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdd6893-4366-49e2-bbbf-710d4a3d3496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d44b58ec8364ea69f2d92ca46ef16b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:07Z,use_quota=True,user_id='411598d776b84b6ea5b938cb66e68f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e8f656-b14a-4644-9d77-e92445f49c17),volume_type_id=f8e8f656-b14a-4644-9d77-e92445f49c17)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee3112a-17f9-4f15-a394-40ccba856cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee3112a-17f9-4f15-a394-40ccba856cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32e9727-d92c-49c0-a2d3-77184cd500b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Created reservations ['45e5eaab-d8e9-48ff-b4e4-06d8d102c0b4', 'acfdc601-988d-47b4-b70f-ea2c8d97745e', '8aadc8a8-3e2a-4400-981d-290156823d92', '4129f098-9424-4639-8292-8f2c423fae7d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:08 devstack sudo[97728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:08 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32e9727-d92c-49c0-a2d3-77184cd500b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afdd6893-4366-49e2-bbbf-710d4a3d3496', 'volume_name': 'volume-afdd6893-4366-49e2-bbbf-710d4a3d3496', 'volume_size': 1, 'image_id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e007b4d-4600-495e-bc5d-92d12e7d781d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--872255466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d44b58ec8364ea69f2d92ca46ef16b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'created_at': datetime.datetime(2026, 9, 30, 15, 59, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e007b4d-4600-495e-bc5d-92d12e7d781d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1497c1c70>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d15bc3-cb73-4431-a6ff-46df01776174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d15bc3-cb73-4431-a6ff-46df01776174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1e2438-1fca-4353-9f13-541dc2dfdbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume afdd6893-4366-49e2-bbbf-710d4a3d3496: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afdd6893-4366-49e2-bbbf-710d4a3d3496', 'volume_size': 1, 'image_id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e007b4d-4600-495e-bc5d-92d12e7d781d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--872255466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d44b58ec8364ea69f2d92ca46ef16b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'created_at': datetime.datetime(2026, 9, 30, 15, 59, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e007b4d-4600-495e-bc5d-92d12e7d781d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1497c1c70>}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Trying to clone afdd6893-4366-49e2-bbbf-710d4a3d3496 from image 3e007b4d-4600-495e-bc5d-92d12e7d781d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e007b4d-4600-495e-bc5d-92d12e7d781d', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "cinder-bfdddca5-490b-44cc-baa2-51073c639913-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:08 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.673s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Lock "cinder-bfdddca5-490b-44cc-baa2-51073c639913-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Deleted volume successfully.
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f018d65d-f3ae-4d7a-beca-102b9ea6982f tempest-VolumesTestJSON-1491892028 None] Lock "cinder-740c57ed-fd94-4155-ae6b-eaca4c06a55e-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "cinder-quobyte-bfdddca5-490b-44cc-baa2-51073c639913" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Lock "cinder-quobyte-bfdddca5-490b-44cc-baa2-51073c639913" acquired by "delete_volume" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a1185-f3f3-4e71-af9f-50f0b6036eb6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:09 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913
Sep 30 17:59:09 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:09 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913" returned: 0 in 0.840s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:09 devstack sudo[97738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913
Sep 30 17:59:09 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:10 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bfdddca5-490b-44cc-baa2-51073c639913" returned: 0 in 0.555s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Lock "cinder-quobyte-bfdddca5-490b-44cc-baa2-51073c639913" released by "delete_volume" :: held 1.501s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Created reservations ['febb38a6-28c5-429a-9528-a816bcf71a4c', '31335e25-f1fc-4312-8b02-71cf36ec5476', '01636673-b810-4d0b-ac63-2a6df1d356c9', '6e50d9c6-3d8e-4937-980f-b8005142cf9d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:10 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:10 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:11 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.796s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:11 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:11 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Deleted volume successfully.
Sep 30 17:59:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c9c42e01-75fb-4ca4-b0ea-1e92f4e5ba23 tempest-VolumesTestJSON-1491892028 None] Lock "cinder-bfdddca5-490b-44cc-baa2-51073c639913-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:15 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a" returned: 0 in 9.302s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 17:59:15 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Converted 1024.00 MB image at 110.07 MB/s
Sep 30 17:59:15 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a is being set with open permissions: ugo+rw
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:15 devstack sudo[97747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a
Sep 30 17:59:15 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:15 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a" returned: 0 in 0.329s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-9643e875-f08e-4b61-9e44-f3c2e5a2744a" released by "_copy_volume_from_snapshot" :: held 10.773s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-27f913f7-58da-4430-8e15-1ab258847917" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-27f913f7-58da-4430-8e15-1ab258847917" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Deleting offline snapshot 27f913f7-58da-4430-8e15-1ab258847917 of volume 39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] snapshot_file for this snap is: volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d3db2-e932-4cd7-901f-15cbcc9f9f1e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:15 devstack sudo[97750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917
Sep 30 17:59:15 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD, size 20.69 MB, duration 7.42 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 17:59:15 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Image download 20.69 MB at 2.79 MB/s
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c4b7c6-b54e-4825-9c2b-822bf04fb46c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:16 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD
Sep 30 17:59:16 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:16 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917" returned: 0 in 0.506s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39914174-840a-4e41-be1b-ad0c08af33d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deeb1d0-0469-4ac2-929c-3d77070e55ca]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:16 devstack sudo[97758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5
Sep 30 17:59:16 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:16 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Temporary image 3e007b4d-4600-495e-bc5d-92d12e7d781d is fetched for user 411598d776b84b6ea5b938cb66e68f7b. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4c14c7-6b3f-456c-a2fa-d3a3e9c1c751]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:16 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD
Sep 30 17:59:16 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:16 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:16 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5" returned: 0 in 0.794s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:16 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917
Sep 30 17:59:16 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:17 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917" returned: 0 in 0.543s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:17 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917
Sep 30 17:59:17 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:17 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5.27f913f7-58da-4430-8e15-1ab258847917" returned: 0 in 0.293s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-27f913f7-58da-4430-8e15-1ab258847917" released by "_delete_snapshot" :: held 2.270s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.246s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.248s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-660244678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0276a969-dfde-4f4d-b751-26fca2dddbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d44b58ec8364ea69f2d92ca46ef16b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:05Z,use_quota=True,user_id='411598d776b84b6ea5b938cb66e68f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f35bb4-a691-4886-aa50-bdc2a28da48c),volume_type_id=62f35bb4-a691-4886-aa50-bdc2a28da48c)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Creating volume 0276a969-dfde-4f4d-b751-26fca2dddbd3 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:17 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:17 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 1073741824
Sep 30 17:59:17 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f516b30-c35a-46f6-9319-908c14209566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a', 'volume_size': 1, 'source_volid': '39914174-840a-4e41-be1b-ad0c08af33d5', 'source_volstatus': 'available'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa180668-52ff-4e15-a5ef-af9260429914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:17 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Volume volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a (9643e875-f08e-4b61-9e44-f3c2e5a2744a): created successfully
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa180668-52ff-4e15-a5ef-af9260429914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (cb39df0c-9477-44bf-8dc9-8130833de53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f8c9304a-c5d8-4bba-a380-616d0cd58e82 tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:59:18 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 1073741824" returned: 0 in 0.591s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:18 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3
Sep 30 17:59:18 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-69631296-4e64-424a-be1a-71a322d10464 tempest-GroupSnapshotsV319Test-1241701115 None] Group tempest-GroupSnapshotsV319Test-Group-1106153789: creating
Sep 30 17:59:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-69631296-4e64-424a-be1a-71a322d10464 tempest-GroupSnapshotsV319Test-1241701115 None] Group tempest-GroupSnapshotsV319Test-Group-1106153789: created successfully
Sep 30 17:59:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-69631296-4e64-424a-be1a-71a322d10464 tempest-GroupSnapshotsV319Test-1241701115 None] Create group completed successfully.
Sep 30 17:59:18 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3" returned: 0 in 0.380s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.781s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1395814763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e18817-5816-4365-8d29-81ee8c4ebf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d44b58ec8364ea69f2d92ca46ef16b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:06Z,use_quota=True,user_id='411598d776b84b6ea5b938cb66e68f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0efe42c0-c835-4a8d-9330-63f78c3ca2f1),volume_type_id=0efe42c0-c835-4a8d-9330-63f78c3ca2f1)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Creating volume b9e18817-5816-4365-8d29-81ee8c4ebf7f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:18 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:18 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f 1073741824
Sep 30 17:59:18 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbfd59b-61a4-4590-9343-c546cc8a6517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0276a969-dfde-4f4d-b751-26fca2dddbd3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153c27f1-75ae-4ddc-a793-37b06b146917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:18 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 (0276a969-dfde-4f4d-b751-26fca2dddbd3): created successfully
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153c27f1-75ae-4ddc-a793-37b06b146917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Flow 'volume_create_manager' (7bbbd5f2-edfa-42ce-b902-9273e4752706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-daccda2c-d173-4ed5-9bd0-2a0c2f8d0f55 tempest-TestInstancesWithCinderVolumes-1401940338 None] Created volume successfully.
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (2c1b9984-611c-49ce-afa9-e0be04c60efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb6b77d-5b65-4d58-9b84-21931fdec929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb6b77d-5b65-4d58-9b84-21931fdec929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124666105',display_name='tempest-VolumesGetTest-Volume-1080372857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4631b9f6-c071-4b47-b8a1-3d2a0e987b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:19Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5944de-c9f8-4578-8a25-e919c3cc67db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5944de-c9f8-4578-8a25-e919c3cc67db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9993ee7-d56c-4ac9-b29c-fd849d9a9874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9993ee7-d56c-4ac9-b29c-fd849d9a9874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4631b9f6-c071-4b47-b8a1-3d2a0e987b2b', 'volume_name': 'volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b940d56-2b23-46fa-afe2-831b0d671799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b940d56-2b23-46fa-afe2-831b0d671799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34d2364-63fa-411f-a491-647124fa029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:19 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Volume 4631b9f6-c071-4b47-b8a1-3d2a0e987b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b', 'volume_size': 1}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:19 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f 1073741824" returned: 0 in 0.546s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:19 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f
Sep 30 17:59:19 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:20 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f" returned: 0 in 0.559s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.142s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1366469569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdd6893-4366-49e2-bbbf-710d4a3d3496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d44b58ec8364ea69f2d92ca46ef16b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:07Z,use_quota=True,user_id='411598d776b84b6ea5b938cb66e68f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e8f656-b14a-4644-9d77-e92445f49c17),volume_type_id=f8e8f656-b14a-4644-9d77-e92445f49c17)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Creating volume afdd6893-4366-49e2-bbbf-710d4a3d3496 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:20 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:20 devstack sudo[97851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 1073741824
Sep 30 17:59:20 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e2d2ae-7fee-4d56-a6a6-20eb0bba0353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6924e01b-43a2-4d54-bd79-af0f19000a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f (b9e18817-5816-4365-8d29-81ee8c4ebf7f): created successfully
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6924e01b-43a2-4d54-bd79-af0f19000a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Flow 'volume_create_manager' (afd18fa4-0219-472f-b6bd-5207a51f5ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f4223f09-0863-494c-904f-93474eabe664 tempest-TestInstancesWithCinderVolumes-1401940338 None] Created volume successfully.
Sep 30 17:59:20 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 1073741824" returned: 0 in 0.912s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:21 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496
Sep 30 17:59:21 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Flow 'volume_create_manager' (3061c17d-385f-44fe-8152-668d39155efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f518c03-2d69-4938-8d04-8661e575b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f518c03-2d69-4938-8d04-8661e575b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90451300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94edf895-0f34-47ac-b7ed-ff1ab760559b,host='devstack@QuobyteHD#QuobyteHD',id=5f758533-e514-428e-8266-9253394bb2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5af57930542c28253017cb7a596bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:21Z,use_quota=True,user_id='16c49d6bca3d4d22b9e105fdb811a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf19e0d7-41fe-44eb-8b01-1134b7fa8ee2),volume_type_id=cf19e0d7-41fe-44eb-8b01-1134b7fa8ee2)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa5c143-a439-4026-a6b8-cf8f56b4da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa5c143-a439-4026-a6b8-cf8f56b4da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8859de7e-f9fe-4fb2-a9fa-15691b1b6c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8859de7e-f9fe-4fb2-a9fa-15691b1b6c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f758533-e514-428e-8266-9253394bb2bb', 'volume_name': 'volume-5f758533-e514-428e-8266-9253394bb2bb', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575779dc-2775-4a92-bcf5-5761932a85b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575779dc-2775-4a92-bcf5-5761932a85b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa245a3-5da6-4c68-b297-375034a8926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Volume 5f758533-e514-428e-8266-9253394bb2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f758533-e514-428e-8266-9253394bb2bb', 'volume_size': 1}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:21 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124666105',display_name='tempest-VolumesGetTest-Volume-1080372857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4631b9f6-c071-4b47-b8a1-3d2a0e987b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:19Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Creating volume 4631b9f6-c071-4b47-b8a1-3d2a0e987b2b {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:21 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:21 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b 1073741824
Sep 30 17:59:21 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Attempting download of 3e007b4d-4600-495e-bc5d-92d12e7d781d ((None, [{'url': 'file:///opt/stack/data/glance/images/3e007b4d-4600-495e-bc5d-92d12e7d781d', 'metadata': {}}])) to volume afdd6893-4366-49e2-bbbf-710d4a3d3496. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a9657a-3ca4-43fe-aaa6-3642e70e7f62]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:21 devstack sudo[97904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml
Sep 30 17:59:21 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:21 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml" returned: 0 in 0.361s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:21 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b 1073741824" returned: 0 in 0.471s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:21 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b
Sep 30 17:59:21 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:21 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml
Sep 30 17:59:21 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:22 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml" returned: 1 in 0.416s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e007b4d-4600-495e-bc5d-92d12e7d781d_97q2qdml' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[148ab043-7607-400f-9c55-1982b893dba6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:22 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b" returned: 0 in 0.397s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94edf895-0f34-47ac-b7ed-ff1ab760559b,created_at=2026-09-30T15:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90451300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94edf895-0f34-47ac-b7ed-ff1ab760559b,host='devstack@QuobyteHD#QuobyteHD',id=5f758533-e514-428e-8266-9253394bb2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5af57930542c28253017cb7a596bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:21Z,use_quota=True,user_id='16c49d6bca3d4d22b9e105fdb811a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf19e0d7-41fe-44eb-8b01-1134b7fa8ee2),volume_type_id=cf19e0d7-41fe-44eb-8b01-1134b7fa8ee2)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Creating volume 5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:22 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:22 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb 1073741824
Sep 30 17:59:22 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34d2364-63fa-411f-a491-647124fa029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6b785-f844-4589-859c-fd939bad0e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:22 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Volume volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b (4631b9f6-c071-4b47-b8a1-3d2a0e987b2b): created successfully
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6b785-f844-4589-859c-fd939bad0e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:22 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD
Sep 30 17:59:22 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (2c1b9984-611c-49ce-afa9-e0be04c60efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:22 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9b3d8065-899f-42ce-bd55-2c2c95ba2846 tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:59:22 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] 3e007b4d-4600-495e-bc5d-92d12e7d781d was qcow2, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:22 devstack sudo[97932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496
Sep 30 17:59:22 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:22 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb 1073741824" returned: 0 in 0.582s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:22 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb
Sep 30 17:59:22 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:23 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa245a3-5da6-4c68-b297-375034a8926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f758533-e514-428e-8266-9253394bb2bb', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d0ddd4-5ac7-49dc-977d-5ca1d6332b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Volume volume-5f758533-e514-428e-8266-9253394bb2bb (5f758533-e514-428e-8266-9253394bb2bb): created successfully
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d0ddd4-5ac7-49dc-977d-5ca1d6332b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Flow 'volume_create_manager' (3061c17d-385f-44fe-8152-668d39155efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a12c5618-6dc2-4512-9aab-248a776a4c9a tempest-GroupSnapshotsV319Test-1241701115 None] Created volume successfully.
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] GroupSnapshot a927cf00-73e8-47f3-9261-274e4c400bf4: creating.
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Lock "cinder-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Group snapshot a927cf00-73e8-47f3-9261-274e4c400bf4: creating. {{(pid=87418) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Creating offline snapshot b82190bd-972b-46f5-a56f-d1afda107b39 of volume 5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b288f3-2757-41f3-bbe8-83d74c049638]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b" acquired by "delete_volume" :: waited 0.046s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[216cd935-69b4-4512-b5db-3872e752de96]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:24 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb
Sep 30 17:59:24 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:24 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b
Sep 30 17:59:24 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:24 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b" returned: 0 in 0.528s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:24 devstack sudo[97952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b
Sep 30 17:59:24 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:24 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb" returned: 0 in 0.742s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:24 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 1G
Sep 30 17:59:24 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:25 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b" returned: 0 in 0.594s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b" released by "delete_volume" :: held 1.193s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:25 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 1G" returned: 0 in 0.605s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f758533-e514-428e-8266-9253394bb2bb -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Created reservations ['98c97514-62ab-4df1-90c2-71200214a49f', 'd5370fd6-4e93-4e97-a8e3-a0765b11c4cf', '6da07ad3-6def-4bcf-a1fd-b9d8b69b08b4', '46349428-a8b6-4660-9f47-12ed9886667c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:25 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f758533-e514-428e-8266-9253394bb2bb -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39
Sep 30 17:59:25 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:25 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:25 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:25 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496" returned: 0 in 2.894s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e007b4d-4600-495e-bc5d-92d12e7d781d_2aoahpskdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 17:59:25 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Converted 112.00 MB image at 38.68 MB/s
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:25 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 1G
Sep 30 17:59:25 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:25 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f758533-e514-428e-8266-9253394bb2bb -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:25 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:25 devstack sudo[97977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39
Sep 30 17:59:25 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:25 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.370s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:59:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1650308f-0d63-4494-8d85-7c1f6e938c27 tempest-VolumesGetTest-1505307289 None] Lock "cinder-4631b9f6-c071-4b47-b8a1-3d2a0e987b2b-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:26 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 1G" returned: 0 in 0.425s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Downloaded image 3e007b4d-4600-495e-bc5d-92d12e7d781d ((None, [{'url': 'file:///opt/stack/data/glance/images/3e007b4d-4600-495e-bc5d-92d12e7d781d', 'metadata': {}}])) to volume afdd6893-4366-49e2-bbbf-710d4a3d3496 successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Temporary image 3e007b4d-4600-495e-bc5d-92d12e7d781d for user 411598d776b84b6ea5b938cb66e68f7b is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Marking volume afdd6893-4366-49e2-bbbf-710d4a3d3496 as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Copying metadata from image 3e007b4d-4600-495e-bc5d-92d12e7d781d to afdd6893-4366-49e2-bbbf-710d4a3d3496. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Creating volume glance metadata for volume afdd6893-4366-49e2-bbbf-710d4a3d3496 backed by image 3e007b4d-4600-495e-bc5d-92d12e7d781d with: {'image_id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'image_name': 'tempest-scenario-img--872255466', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 17:59:26 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39" returned: 0 in 0.298s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:26 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info
Sep 30 17:59:26 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1e2438-1fca-4353-9f13-541dc2dfdbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afdd6893-4366-49e2-bbbf-710d4a3d3496', 'volume_size': 1, 'image_id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e007b4d-4600-495e-bc5d-92d12e7d781d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--872255466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d44b58ec8364ea69f2d92ca46ef16b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e007b4d-4600-495e-bc5d-92d12e7d781d', 'created_at': datetime.datetime(2026, 9, 30, 15, 59, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e007b4d-4600-495e-bc5d-92d12e7d781d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1497c1c70>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268736e4-21d7-4db5-bfa4-afe995fd62b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Volume volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 (afdd6893-4366-49e2-bbbf-710d4a3d3496): created successfully
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268736e4-21d7-4db5-bfa4-afe995fd62b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Flow 'volume_create_manager' (bade1fb3-bcdb-44aa-8658-6d6a7840ab71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9b21d715-417b-4d64-a0f7-694fa3ce812c tempest-TestInstancesWithCinderVolumes-1401940338 None] Created volume successfully.
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-9643e875-f08e-4b61-9e44-f3c2e5a2744a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Lock "cinder-9643e875-f08e-4b61-9e44-f3c2e5a2744a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-9643e875-f08e-4b61-9e44-f3c2e5a2744a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-9643e875-f08e-4b61-9e44-f3c2e5a2744a" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:26 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info" returned: 0 in 0.391s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:26 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc16f16-9b18-48e2-a6fd-62270d6e6480]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:26 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info
Sep 30 17:59:26 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:26 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a
Sep 30 17:59:26 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:26 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.info" returned: 0 in 0.309s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-90eac543-587d-44e6-8b7a-dd5ebdcf6d56 tempest-GroupSnapshotsV319Test-1241701115 None] group_snapshot a927cf00-73e8-47f3-9261-274e4c400bf4: created successfully
Sep 30 17:59:27 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a" returned: 0 in 0.437s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:27 devstack sudo[97996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a
Sep 30 17:59:27 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:27 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9643e875-f08e-4b61-9e44-f3c2e5a2744a" returned: 0 in 0.276s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-9643e875-f08e-4b61-9e44-f3c2e5a2744a" released by "delete_volume" :: held 0.791s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Created reservations ['9c78010e-3a15-42b7-bd77-c1572a4a7cee', 'b5424643-794b-45a0-9208-663d2ad663fb', 'e88afab9-25bb-4581-bef0-82062080e848', '2b5dd217-4578-49f0-892e-0f29fc508e2c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:27 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:27 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-39914174-840a-4e41-be1b-ad0c08af33d5-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Lock "cinder-39914174-840a-4e41-be1b-ad0c08af33d5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:27 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-39914174-840a-4e41-be1b-ad0c08af33d5" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-69452ac4-620e-48b4-be5d-0c12452aa3dd tempest-VolumesGetTest-1505307289 None] Lock "cinder-9643e875-f08e-4b61-9e44-f3c2e5a2744a-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] group_snapshot a927cf00-73e8-47f3-9261-274e4c400bf4: deleting
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-39914174-840a-4e41-be1b-ad0c08af33d5" acquired by "delete_volume" :: waited 0.066s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae38ae58-fe41-47a3-8375-234874975cc8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] group_snapshot a927cf00-73e8-47f3-9261-274e4c400bf4: deleting {{(pid=87418) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "cinder-quobyte-5f758533-e514-428e-8266-9253394bb2bb" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Lock "cinder-quobyte-5f758533-e514-428e-8266-9253394bb2bb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "cinder-quobyte-b82190bd-972b-46f5-a56f-d1afda107b39" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Lock "cinder-quobyte-b82190bd-972b-46f5-a56f-d1afda107b39" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Deleting offline snapshot b82190bd-972b-46f5-a56f-d1afda107b39 of volume 5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] snapshot_file for this snap is: volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 17:59:28 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5
Sep 30 17:59:28 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3208235-6175-4b6a-acfa-ac6f9aefa699]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:28 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39
Sep 30 17:59:28 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:28 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5" returned: 0 in 0.527s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:28 devstack sudo[98012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5
Sep 30 17:59:28 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:28 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39" returned: 0 in 0.515s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f758533-e514-428e-8266-9253394bb2bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a90303-5901-4103-ba88-e38cbae4aba6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:29 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39914174-840a-4e41-be1b-ad0c08af33d5" returned: 0 in 0.384s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-39914174-840a-4e41-be1b-ad0c08af33d5" released by "delete_volume" :: held 1.053s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:29 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb
Sep 30 17:59:29 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Created reservations ['60d3cffd-07e6-4447-9f48-5b35b53a483b', '2e4118a1-9356-4fef-bac3-c5c54d717235', 'e4b30a93-fe5c-4d55-bc02-131597aaffb7', 'ac834ef1-372f-4dae-a1f7-8ee870529082'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:29 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:29 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:29 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:29 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.325s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb" returned: 0 in 0.653s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=112,cinder:INSERT=39,cinder:UPDATE=161,cinder:DELETE=19 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:59:29 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39
Sep 30 17:59:29 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9052116c-9049-4877-8a5e-8be0c12bb0d1 tempest-VolumesGetTest-1505307289 None] Lock "cinder-39914174-840a-4e41-be1b-ad0c08af33d5-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=118,cinder:INSERT=40,cinder:UPDATE=140,cinder:DELETE=8 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-0360d1b8-31cb-4ccf-b05f-19ee437efe26 req-8ec67b1b-1dc2-4905-9626-8aaf6693a340 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-0360d1b8-31cb-4ccf-b05f-19ee437efe26 req-8ec67b1b-1dc2-4905-9626-8aaf6693a340 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-0360d1b8-31cb-4ccf-b05f-19ee437efe26 req-8ec67b1b-1dc2-4905-9626-8aaf6693a340 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:30 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39" returned: 0 in 0.498s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-0360d1b8-31cb-4ccf-b05f-19ee437efe26 req-8ec67b1b-1dc2-4905-9626-8aaf6693a340 tempest-TestInstancesWithCinderVolumes-1401940338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-afdd6893-4366-49e2-bbbf-710d4a3d3496', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5a5d2e7-9743-4e4f-94db-6132f8cdce14', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:59:30 devstack sudo[98040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39
Sep 30 17:59:30 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-0360d1b8-31cb-4ccf-b05f-19ee437efe26 req-8ec67b1b-1dc2-4905-9626-8aaf6693a340 tempest-TestInstancesWithCinderVolumes-1401940338 None] attachment_update completed successfully.
Sep 30 17:59:30 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb.b82190bd-972b-46f5-a56f-d1afda107b39" returned: 0 in 0.337s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Lock "cinder-quobyte-b82190bd-972b-46f5-a56f-d1afda107b39" released by "_delete_snapshot" :: held 2.217s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Lock "cinder-quobyte-5f758533-e514-428e-8266-9253394bb2bb" released by "delete_snapshot" :: held 2.272s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:30 devstack cinder-volume[87418]: WARNING cinder.quota [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-814063602 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-814063602, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:59:30 devstack cinder-volume[87418]: WARNING cinder.quota [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-814063602 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-814063602, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:59:30 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] Created reservations ['38e64253-4fa0-4ad0-a33a-d8eebc8b2662', 'db4cf9d7-366e-4113-8b8b-fa4f40019275', '66f84d5d-489f-4f90-af54-19e66ed697b1', '8b8d0af2-b1ea-424e-a426-029496dccbc1'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-eae6a792-e695-4938-8efb-88215df53b5d tempest-GroupSnapshotsV319Test-1241701115 None] group_snapshot a927cf00-73e8-47f3-9261-274e4c400bf4: deleted successfully
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (7e1e0e71-7e0f-46fe-8a09-0cd51f32e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264c3e0b-2020-4f65-84b4-5e67a6c52c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264c3e0b-2020-4f65-84b4-5e67a6c52c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1644953165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d9331d-9c37-4831-9ddf-7639c9ab2f5c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:31Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c322c0c-67ca-417b-b3df-e42e29fd99b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c322c0c-67ca-417b-b3df-e42e29fd99b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53980943-e12c-4216-a784-4a6e893b688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:31 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "cinder-quobyte-5f758533-e514-428e-8266-9253394bb2bb" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53980943-e12c-4216-a784-4a6e893b688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13d9331d-9c37-4831-9ddf-7639c9ab2f5c', 'volume_name': 'volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f2cd310>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae53ea82-5fbc-4357-9a45-97ce9215ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae53ea82-5fbc-4357-9a45-97ce9215ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5217c00-7974-4d18-b6e5-b20b6dd83c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:32 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Volume 13d9331d-9c37-4831-9ddf-7639c9ab2f5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f2cd310>}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Trying to clone 13d9331d-9c37-4831-9ddf-7639c9ab2f5c from image 90139efc-54c0-4670-ab72-2da0af285eb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Lock "cinder-quobyte-5f758533-e514-428e-8266-9253394bb2bb" acquired by "delete_volume" :: waited 0.094s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c44172-bc93-4322-bdaf-9a9439350200]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:32 devstack sudo[98044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb
Sep 30 17:59:32 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 17:59:32 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a389a-b681-4054-a556-fdd65d7ecd9b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:32 devstack sudo[98048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD
Sep 30 17:59:32 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:32 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb" returned: 0 in 0.771s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:33 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb
Sep 30 17:59:33 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:33 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 is fetched for user 415d62bae1f0427d952b1b0588daa6ac. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b818fb7-3af7-48f8-9453-5ea544d49e8b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:33 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f758533-e514-428e-8266-9253394bb2bb" returned: 0 in 0.423s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Lock "cinder-quobyte-5f758533-e514-428e-8266-9253394bb2bb" released by "delete_volume" :: held 1.310s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Created reservations ['4467f8a6-4b0e-4ba1-9e58-8f4f5dc58e63'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:33 devstack sudo[98063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD
Sep 30 17:59:33 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:33 devstack cinder-volume[87418]: WARNING cinder.quota [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-814063602 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-814063602, it is now deprecated. Please use the default quota class for default quota.
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Created reservations ['8517ea88-8273-49a8-963b-78c1cce35e5b', '2b2d3dad-35c6-464f-aa7c-d71a1f6b3ccf', '33eee08f-39c3-49c6-a94b-a02495433274', '08bdb8bb-8fff-4b7b-9a50-ab3d2aabc924'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:33 devstack sudo[98164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:33 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:34 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1644953165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d9331d-9c37-4831-9ddf-7639c9ab2f5c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:31Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Creating volume 13d9331d-9c37-4831-9ddf-7639c9ab2f5c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:34 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:34 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c 1073741824
Sep 30 17:59:34 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:34 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.713s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:34 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c06fc83d-8b2c-4c8b-b672-5425a2ce1149 tempest-GroupSnapshotsV319Test-1241701115 None] Delete group completed successfully.
Sep 30 17:59:35 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c 1073741824" returned: 0 in 1.085s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:35 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c
Sep 30 17:59:35 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:35 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" returned: 0 in 0.376s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Attempting download of 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume 13d9331d-9c37-4831-9ddf-7639c9ab2f5c. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e600551e-a1e6-4e28-a492-5ad6fcc13540]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:36 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd
Sep 30 17:59:36 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:36 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd" returned: 0 in 0.373s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:36 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd
Sep 30 17:59:36 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:36 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd" returned: 1 in 0.330s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_hj_uf2hd' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 17:59:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d309ad25-4d8a-4717-b4d0-58e03f9727f8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:36 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD
Sep 30 17:59:36 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:37 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:37 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] 90139efc-54c0-4670-ab72-2da0af285eb6 was qcow2, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 17:59:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:37 devstack sudo[98605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c
Sep 30 17:59:37 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:39 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" returned: 0 in 2.683s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:39 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_e3_2n6jydevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 17:59:39 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Converted 112.00 MB image at 41.67 MB/s
Sep 30 17:59:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:39 devstack sudo[98615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c 1G
Sep 30 17:59:39 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:40 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c 1G" returned: 0 in 0.462s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Downloaded image 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume 13d9331d-9c37-4831-9ddf-7639c9ab2f5c successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 for user 415d62bae1f0427d952b1b0588daa6ac is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Marking volume 13d9331d-9c37-4831-9ddf-7639c9ab2f5c as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Copying metadata from image 90139efc-54c0-4670-ab72-2da0af285eb6 to 13d9331d-9c37-4831-9ddf-7639c9ab2f5c. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Creating volume glance metadata for volume 13d9331d-9c37-4831-9ddf-7639c9ab2f5c backed by image 90139efc-54c0-4670-ab72-2da0af285eb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5217c00-7974-4d18-b6e5-b20b6dd83c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f2cd310>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b977e-577f-4995-885d-b8cede24bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:40 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Volume volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c (13d9331d-9c37-4831-9ddf-7639c9ab2f5c): created successfully
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b977e-577f-4995-885d-b8cede24bd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (7e1e0e71-7e0f-46fe-8a09-0cd51f32e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:40 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-69dda80e-0ece-4caa-b367-04f8b9228c14 tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (16a0312a-ddb0-462a-8844-9b6eb05cb45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7169ae79-4942-4723-9a1b-213ea4cb4db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7169ae79-4942-4723-9a1b-213ea4cb4db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1165275929',display_name='tempest-VolumesGetTest-Volume-75901929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c82062-c014-4e0c-9772-9ed4b54a3f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:43Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1445ad8c-e084-4c1b-b723-e6e36a3bd2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1445ad8c-e084-4c1b-b723-e6e36a3bd2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977b38b3-4f91-4130-9c92-ceed597c7acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977b38b3-4f91-4130-9c92-ceed597c7acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c82062-c014-4e0c-9772-9ed4b54a3f9d', 'volume_name': 'volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9377352b-953f-4257-af6b-d5b0e77a6595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9377352b-953f-4257-af6b-d5b0e77a6595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c83304d-9346-40d7-8201-2f56cc7c348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:43 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Volume c8c82062-c014-4e0c-9772-9ed4b54a3f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d', 'volume_size': 1}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1165275929',display_name='tempest-VolumesGetTest-Volume-75901929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c82062-c014-4e0c-9772-9ed4b54a3f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a320e4abf4099b8b12625bfb6dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:43Z,use_quota=True,user_id='415d62bae1f0427d952b1b0588daa6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Creating volume c8c82062-c014-4e0c-9772-9ed4b54a3f9d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:43 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:43 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d 1073741824
Sep 30 17:59:43 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:44 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d 1073741824" returned: 0 in 0.924s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:44 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d
Sep 30 17:59:44 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:44 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d" returned: 0 in 0.329s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c83304d-9346-40d7-8201-2f56cc7c348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e8c3a1-516e-409f-9805-323ee34f5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:44 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Volume volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d (c8c82062-c014-4e0c-9772-9ed4b54a3f9d): created successfully
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e8c3a1-516e-409f-9805-323ee34f5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Flow 'volume_create_manager' (16a0312a-ddb0-462a-8844-9b6eb05cb45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-372d2b23-8578-4d0f-ae90-ecdaef3fae9e tempest-VolumesGetTest-1505307289 None] Created volume successfully.
Sep 30 17:59:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-c8c82062-c014-4e0c-9772-9ed4b54a3f9d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Lock "cinder-c8c82062-c014-4e0c-9772-9ed4b54a3f9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-c8c82062-c014-4e0c-9772-9ed4b54a3f9d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-c8c82062-c014-4e0c-9772-9ed4b54a3f9d" acquired by "delete_volume" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[35953e05-f23c-4283-929f-c280b81d5897]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:45 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d
Sep 30 17:59:45 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:46 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d" returned: 0 in 0.520s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:46 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d
Sep 30 17:59:46 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:46 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:46 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Flow 'volume_create_manager' (5bc57a2c-d420-46b8-90ed-daf670a7dd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b57ab11-6304-47fc-becc-db648bf76584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b57ab11-6304-47fc-becc-db648bf76584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-152638487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c79096-7fc0-4927-97b9-cfc6ba0e3e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524a0534fc94e05934cce5f06f5b74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:46Z,use_quota=True,user_id='e2cdc74a79b44a8bbf82da8a18953d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72496099-6a85-4578-9d7c-f1ec7a9a99c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72496099-6a85-4578-9d7c-f1ec7a9a99c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98924949-fe91-4ba2-b13a-7499fcece416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98924949-fe91-4ba2-b13a-7499fcece416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c79096-7fc0-4927-97b9-cfc6ba0e3e60', 'volume_name': 'volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2d050e-ea08-405a-82a7-1b91652b0232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2d050e-ea08-405a-82a7-1b91652b0232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c16d516-8726-4b5e-b3b8-9bb8d8134c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:46 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Volume 44c79096-7fc0-4927-97b9-cfc6ba0e3e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60', 'volume_size': 1}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-152638487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c79096-7fc0-4927-97b9-cfc6ba0e3e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524a0534fc94e05934cce5f06f5b74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:46Z,use_quota=True,user_id='e2cdc74a79b44a8bbf82da8a18953d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Creating volume 44c79096-7fc0-4927-97b9-cfc6ba0e3e60 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:46 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:46 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c8c82062-c014-4e0c-9772-9ed4b54a3f9d" returned: 0 in 0.532s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:46 devstack sudo[98696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 1073741824
Sep 30 17:59:46 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-c8c82062-c014-4e0c-9772-9ed4b54a3f9d" released by "delete_volume" :: held 1.142s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:46 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Created reservations ['641949fc-7cd4-4e5c-91da-295018ec9831', '8014ec6e-e26b-44e5-bec7-9160e6696c36', '72908538-3f17-49f0-8286-7fcb53880b99', 'b95e2873-1288-417b-8230-bcc80fd74984'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:47 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.696s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:47 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:47 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:47 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 1073741824" returned: 0 in 0.793s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:47 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60
Sep 30 17:59:47 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:47 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.437s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:59:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e92334cc-9511-4b37-8fc7-040cb14829b5 tempest-VolumesGetTest-1505307289 None] Lock "cinder-c8c82062-c014-4e0c-9772-9ed4b54a3f9d-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:48 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60" returned: 0 in 0.477s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c16d516-8726-4b5e-b3b8-9bb8d8134c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb1d383-fc59-4475-9dad-c0c311319b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Volume volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 (44c79096-7fc0-4927-97b9-cfc6ba0e3e60): created successfully
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb1d383-fc59-4475-9dad-c0c311319b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Flow 'volume_create_manager' (5bc57a2c-d420-46b8-90ed-daf670a7dd2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-13d9331d-9c37-4831-9ddf-7639c9ab2f5c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1c64fddd-0738-44cd-b15e-80294032851a tempest-AttachVolumeTestJSON-1438487512 None] Created volume successfully.
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Lock "cinder-13d9331d-9c37-4831-9ddf-7639c9ab2f5c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Acquiring lock "cinder-quobyte-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" acquired by "delete_volume" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a36f60-50f2-4b55-816a-4127a253dbf8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:48 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c
Sep 30 17:59:48 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:49 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" returned: 0 in 0.768s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:49 devstack sudo[98717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c
Sep 30 17:59:49 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:49 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Lock "cinder-quobyte-13d9331d-9c37-4831-9ddf-7639c9ab2f5c" released by "delete_volume" :: held 1.304s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Created reservations ['cb5c61ce-80e5-4083-a943-30ba065beecd', 'eb34b6fe-db37-422c-9875-7563f82ec6b9', '81d11931-0f6c-456c-a7e6-f240bb6b9b7b', 'f949cc9c-fc33-439a-80f7-5496cac9fd4f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:49 devstack sudo[98720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 17:59:49 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:50 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 17:59:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Deleted volume successfully.
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ef1cdade-ce58-4903-917d-50742382cd55 tempest-VolumesGetTest-1505307289 None] Lock "cinder-13d9331d-9c37-4831-9ddf-7639c9ab2f5c-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-06cd6317-4c27-4b09-a20a-b1b7664af523 req-0ee8460d-bc3f-49e6-a69a-32274d82616b tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-06cd6317-4c27-4b09-a20a-b1b7664af523 req-0ee8460d-bc3f-49e6-a69a-32274d82616b tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-06cd6317-4c27-4b09-a20a-b1b7664af523 req-0ee8460d-bc3f-49e6-a69a-32274d82616b tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-06cd6317-4c27-4b09-a20a-b1b7664af523 req-0ee8460d-bc3f-49e6-a69a-32274d82616b tempest-AttachVolumeTestJSON-1438487512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32dd3ea9-184e-48e0-a5a9-e7bbbdded8f9', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:59:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-06cd6317-4c27-4b09-a20a-b1b7664af523 req-0ee8460d-bc3f-49e6-a69a-32274d82616b tempest-AttachVolumeTestJSON-1438487512 None] attachment_update completed successfully.
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Flow 'volume_create_manager' (c9fc4077-fabf-4005-9aa3-f04d3d26015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb74d21-7cf0-4a9a-a2d1-b657b639bedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb74d21-7cf0-4a9a-a2d1-b657b639bedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-553740326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41471bd4-8d15-416e-a341-be1eece742c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524a0534fc94e05934cce5f06f5b74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:53Z,use_quota=True,user_id='e2cdc74a79b44a8bbf82da8a18953d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c1365e-7e43-470b-95f8-56955e3f8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c1365e-7e43-470b-95f8-56955e3f8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61278f2-e628-498d-a540-81cd9fef6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61278f2-e628-498d-a540-81cd9fef6454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41471bd4-8d15-416e-a341-be1eece742c8', 'volume_name': 'volume-41471bd4-8d15-416e-a341-be1eece742c8', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37431e2a-390b-4628-8916-8f8a139fc98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37431e2a-390b-4628-8916-8f8a139fc98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b6358e-b106-48b1-8c51-908e690f1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:53 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Volume 41471bd4-8d15-416e-a341-be1eece742c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41471bd4-8d15-416e-a341-be1eece742c8', 'volume_size': 1}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-553740326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41471bd4-8d15-416e-a341-be1eece742c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524a0534fc94e05934cce5f06f5b74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:53Z,use_quota=True,user_id='e2cdc74a79b44a8bbf82da8a18953d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Creating volume 41471bd4-8d15-416e-a341-be1eece742c8 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:53 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:53 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8 1073741824
Sep 30 17:59:53 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:53 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8 1073741824" returned: 0 in 0.598s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:53 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8
Sep 30 17:59:53 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:54 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8" returned: 0 in 0.329s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b6358e-b106-48b1-8c51-908e690f1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41471bd4-8d15-416e-a341-be1eece742c8', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293ff43e-4fb6-4a8d-8e25-70a0f3735b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Volume volume-41471bd4-8d15-416e-a341-be1eece742c8 (41471bd4-8d15-416e-a341-be1eece742c8): created successfully
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293ff43e-4fb6-4a8d-8e25-70a0f3735b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Flow 'volume_create_manager' (c9fc4077-fabf-4005-9aa3-f04d3d26015d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c512b637-fdbc-424e-940e-db0a3555e205 tempest-AttachVolumeTestJSON-1438487512 None] Created volume successfully.
Sep 30 17:59:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8a1811cc-a183-496f-b774-e83229d3a156 tempest-GroupsTest-1476531542 None] Group tempest-Group1-489305343: creating
Sep 30 17:59:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8a1811cc-a183-496f-b774-e83229d3a156 tempest-GroupsTest-1476531542 None] Group tempest-Group1-489305343: created successfully
Sep 30 17:59:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8a1811cc-a183-496f-b774-e83229d3a156 tempest-GroupsTest-1476531542 None] Create group completed successfully.
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Flow 'volume_create_manager' (9b344575-fc95-4867-aef0-58567e78b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848e650f-3df0-4f89-85f1-d187ab6da278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848e650f-3df0-4f89-85f1-d187ab6da278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-237200118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54107516-5ade-415d-af26-e39a560e8495,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ed2c301384ffb81d19b54a3acc189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:56Z,use_quota=True,user_id='c3d5876849564a0c9382b919582be386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18df8b9-3771-4c7b-89d8-2cd858e320b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18df8b9-3771-4c7b-89d8-2cd858e320b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e4d49f-7018-4e94-b381-e0fb88d941f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e4d49f-7018-4e94-b381-e0fb88d941f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54107516-5ade-415d-af26-e39a560e8495', 'volume_name': 'volume-54107516-5ade-415d-af26-e39a560e8495', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e655288e-7712-43b6-a4c8-4c854aa8a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e655288e-7712-43b6-a4c8-4c854aa8a73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d4cd7c-c92c-4502-8134-e74b227fdade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Volume 54107516-5ade-415d-af26-e39a560e8495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54107516-5ade-415d-af26-e39a560e8495', 'volume_size': 1}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-237200118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54107516-5ade-415d-af26-e39a560e8495,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ed2c301384ffb81d19b54a3acc189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:56Z,use_quota=True,user_id='c3d5876849564a0c9382b919582be386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Creating volume 54107516-5ade-415d-af26-e39a560e8495 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:55 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:55 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495 1073741824
Sep 30 17:59:55 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a3f116ed-2b14-4388-bf52-dee705d69c3b tempest-GroupsTest-1476531542 None] Group tempest-Group2-1016319890: creating
Sep 30 17:59:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a3f116ed-2b14-4388-bf52-dee705d69c3b tempest-GroupsTest-1476531542 None] Group tempest-Group2-1016319890: created successfully
Sep 30 17:59:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a3f116ed-2b14-4388-bf52-dee705d69c3b tempest-GroupsTest-1476531542 None] Create group completed successfully.
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-941cfd51-c7a3-4f3f-902e-94718a868157 req-6a6377cd-7bd3-4606-973b-f56a2955b799 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:56 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495 1073741824" returned: 0 in 0.555s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:56 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495
Sep 30 17:59:56 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:56 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-941cfd51-c7a3-4f3f-902e-94718a868157 req-6a6377cd-7bd3-4606-973b-f56a2955b799 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.412s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-941cfd51-c7a3-4f3f-902e-94718a868157 req-6a6377cd-7bd3-4606-973b-f56a2955b799 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d4cd7c-c92c-4502-8134-e74b227fdade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54107516-5ade-415d-af26-e39a560e8495', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c10014-1080-43c3-8fa5-7ea4f97e5336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:56 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Volume volume-54107516-5ade-415d-af26-e39a560e8495 (54107516-5ade-415d-af26-e39a560e8495): created successfully
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c10014-1080-43c3-8fa5-7ea4f97e5336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Flow 'volume_create_manager' (9b344575-fc95-4867-aef0-58567e78b1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-941cfd51-c7a3-4f3f-902e-94718a868157 req-6a6377cd-7bd3-4606-973b-f56a2955b799 tempest-AttachVolumeTestJSON-1438487512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-41471bd4-8d15-416e-a341-be1eece742c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e666966-98a5-4a49-816c-67e772702f56', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 17:59:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e63920ed-1280-49cf-bdc3-8b71de58d1ef tempest-VolumesListTestJSON-237816726 None] Created volume successfully.
Sep 30 17:59:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-941cfd51-c7a3-4f3f-902e-94718a868157 req-6a6377cd-7bd3-4606-973b-f56a2955b799 tempest-AttachVolumeTestJSON-1438487512 None] attachment_update completed successfully.
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Flow 'volume_create_manager' (ab77ca73-707a-469a-84c4-ed2fd22b672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d5177e-2fd5-43f6-b252-12119147d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d5177e-2fd5-43f6-b252-12119147d959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727195776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7e5db44-93f1-404e-8eee-a4f0d614df31,host='devstack@QuobyteHD#QuobyteHD',id=8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88bbd23c634185abf48f9b1877bde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:57Z,use_quota=True,user_id='d9c85a92605240768f3d3b4e4c39bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e73d71bd-8b2d-4b54-96b4-9aa38ef3ac4a),volume_type_id=e73d71bd-8b2d-4b54-96b4-9aa38ef3ac4a)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2433b747-2fde-4fc9-93d3-42ae95181803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2433b747-2fde-4fc9-93d3-42ae95181803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034248a0-f27e-476b-a294-46157dc87e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034248a0-f27e-476b-a294-46157dc87e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9', 'volume_name': 'volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce1d818-bee8-4724-9298-da9decd62f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce1d818-bee8-4724-9298-da9decd62f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b3b3f8-9bf3-4609-8c26-f57391213e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Volume 8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9', 'volume_size': 1}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a7e5db44-93f1-404e-8eee-a4f0d614df31,created_at=2026-09-30T15:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727195776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7e5db44-93f1-404e-8eee-a4f0d614df31,host='devstack@QuobyteHD#QuobyteHD',id=8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88bbd23c634185abf48f9b1877bde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:57Z,use_quota=True,user_id='d9c85a92605240768f3d3b4e4c39bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e73d71bd-8b2d-4b54-96b4-9aa38ef3ac4a),volume_type_id=e73d71bd-8b2d-4b54-96b4-9aa38ef3ac4a)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Creating volume 8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:57 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:57 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 1073741824
Sep 30 17:59:57 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:57 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 1073741824" returned: 0 in 0.467s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:58 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9
Sep 30 17:59:58 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Flow 'volume_create_manager' (a01fc7e9-ad3d-4050-85a9-a5cb2ce7cec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35dce7c-84e6-4aac-acb8-35944645fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35dce7c-84e6-4aac-acb8-35944645fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-110246517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f58abe7-684d-484f-9e5f-5ac435af5e0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ed2c301384ffb81d19b54a3acc189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:58Z,use_quota=True,user_id='c3d5876849564a0c9382b919582be386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0193a862-a652-416b-a5dc-627c04fdac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0193a862-a652-416b-a5dc-627c04fdac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a54eff0-e252-4328-b2de-c989a2101bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a54eff0-e252-4328-b2de-c989a2101bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f58abe7-684d-484f-9e5f-5ac435af5e0a', 'volume_name': 'volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:58 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3540f878-7b3c-4c43-9e4b-89e14f40da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3540f878-7b3c-4c43-9e4b-89e14f40da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb063c11-c2bc-41d2-90b5-1799f4d5b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Volume 7f58abe7-684d-484f-9e5f-5ac435af5e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a', 'volume_size': 1}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9" returned: 0 in 0.303s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T15:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-110246517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f58abe7-684d-484f-9e5f-5ac435af5e0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ed2c301384ffb81d19b54a3acc189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T15:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T15:59:58Z,use_quota=True,user_id='c3d5876849564a0c9382b919582be386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Creating volume 7f58abe7-684d-484f-9e5f-5ac435af5e0a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 17:59:58 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b3b3f8-9bf3-4609-8c26-f57391213e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:58 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a 1073741824
Sep 30 17:59:58 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affba2c4-a29e-4d2f-b195-7c6afababa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Volume volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 (8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9): created successfully
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affba2c4-a29e-4d2f-b195-7c6afababa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Flow 'volume_create_manager' (ab77ca73-707a-469a-84c4-ed2fd22b672f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ef8fc879-2ed3-4436-a412-34f777b11d2d tempest-GroupsTest-1476531542 None] Created volume successfully.
Sep 30 17:59:58 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a 1073741824" returned: 0 in 0.543s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:58 devstack sudo[98820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a
Sep 30 17:59:58 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:59 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb063c11-c2bc-41d2-90b5-1799f4d5b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ea66ba-a85a-45e3-b4a2-0efc41aece24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 17:59:59 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Volume volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a (7f58abe7-684d-484f-9e5f-5ac435af5e0a): created successfully
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ea66ba-a85a-45e3-b4a2-0efc41aece24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Flow 'volume_create_manager' (a01fc7e9-ad3d-4050-85a9-a5cb2ce7cec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 17:59:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-825dbd8a-acd5-4b34-a411-81a6b72453cc tempest-VolumesListTestJSON-237816726 None] Created volume successfully.
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Acquiring lock "cinder-quobyte-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Lock "cinder-quobyte-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc763bca-b1c9-458e-9e81-d4c6a1bb6de7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-fe9b899e-ab78-4edf-b2ae-d9bfc16e3f43 req-450d3b83-bd58-4f17-8d27-0141b20ffe9f tempest-AttachVolumeTestJSON-1438487512 None] Terminate volume connection completed successfully.
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-fe9b899e-ab78-4edf-b2ae-d9bfc16e3f43 req-450d3b83-bd58-4f17-8d27-0141b20ffe9f tempest-AttachVolumeTestJSON-1438487512 None] Deleting attachment 32dd3ea9-184e-48e0-a5a9-e7bbbdded8f9. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 17:59:59 devstack sudo[98828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9
Sep 30 17:59:59 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:59 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9" returned: 0 in 0.367s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 17:59:59 devstack sudo[98833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9
Sep 30 17:59:59 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 17:59:59 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9" returned: 0 in 0.244s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 17:59:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Lock "cinder-quobyte-8601be5e-93b9-4aa0-88ef-b8b2f0c91cb9" released by "delete_volume" :: held 0.665s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Created reservations ['5f564fb7-32d2-4bba-8d04-bae4bf6f654e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:00 devstack cinder-volume[87418]: WARNING cinder.quota [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-579318870 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-579318870, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:00 devstack cinder-volume[87418]: WARNING cinder.quota [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-579318870 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-579318870, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Created reservations ['a315bea9-7cf2-4491-8a86-cc5d1e51f2a9', '385855a8-122d-42a3-9bb3-eb17f84b058b', 'df5acf00-40ea-4a2f-9124-f65aec4e1761', 'bc20aded-93c2-4677-a477-4172f9bfb342'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:00 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:00 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:00 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.271s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-cf8ceaf9-a826-4867-bd44-a4f03dfd2691 tempest-GroupsTest-1476531542 None] Delete group completed successfully.
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Created reservations ['57ef3e8d-e50c-4df2-af7d-45d88525b8f7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-495195f1-660f-4efe-acbf-f6a2c3270ca7 req-af11f67c-4eff-4489-85df-f4bff3ca8099 tempest-AttachVolumeTestJSON-1438487512 None] Terminate volume connection completed successfully.
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-495195f1-660f-4efe-acbf-f6a2c3270ca7 req-af11f67c-4eff-4489-85df-f4bff3ca8099 tempest-AttachVolumeTestJSON-1438487512 None] Deleting attachment 5e666966-98a5-4a49-816c-67e772702f56. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:00:00 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:00 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Flow 'volume_create_manager' (e7ced007-9787-4377-9515-565df251b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e367ac-82da-42cb-80fc-320362da89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e367ac-82da-42cb-80fc-320362da89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502509929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e9dceb-f29d-4ef2-98fc-93bd1fdab34a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ed2c301384ffb81d19b54a3acc189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:01Z,use_quota=True,user_id='c3d5876849564a0c9382b919582be386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c585cc9-a54a-41ec-9112-27927919e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c585cc9-a54a-41ec-9112-27927919e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6a4b8-dd28-4304-831a-d320da7c8b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6a4b8-dd28-4304-831a-d320da7c8b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e9dceb-f29d-4ef2-98fc-93bd1fdab34a', 'volume_name': 'volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3d15f5-bb3d-49b4-bbbb-0011ad0cde1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3d15f5-bb3d-49b4-bbbb-0011ad0cde1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe92134-5bfb-47c2-bc74-5aa81c56026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:00 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Volume 69e9dceb-f29d-4ef2-98fc-93bd1fdab34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a', 'volume_size': 1}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502509929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e9dceb-f29d-4ef2-98fc-93bd1fdab34a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ed2c301384ffb81d19b54a3acc189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:01Z,use_quota=True,user_id='c3d5876849564a0c9382b919582be386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Creating volume 69e9dceb-f29d-4ef2-98fc-93bd1fdab34a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:00 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:00:00 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:00:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.286s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-772be0c7-c08b-4edf-8fc0-87a83745a653 tempest-GroupsTest-1476531542 None] Delete group completed successfully.
Sep 30 18:00:01 devstack sudo[98848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a 1073741824
Sep 30 18:00:01 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:01 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a 1073741824" returned: 0 in 0.441s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:01 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a
Sep 30 18:00:01 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:01 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a" returned: 0 in 0.265s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe92134-5bfb-47c2-bc74-5aa81c56026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c111b4f8-9df9-4187-9147-98220e98c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:01 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Volume volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a (69e9dceb-f29d-4ef2-98fc-93bd1fdab34a): created successfully
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c111b4f8-9df9-4187-9147-98220e98c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Flow 'volume_create_manager' (e7ced007-9787-4377-9515-565df251b84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b3e8dafc-d691-4dc2-9328-5dd4bbc426f7 tempest-VolumesListTestJSON-237816726 None] Created volume successfully.
Sep 30 18:00:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2680a97b-6b99-4871-a256-29c6a26838fa tempest-GroupsTest-1476531542 None] Group tempest-GroupsTest-Group-886134307: creating
Sep 30 18:00:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2680a97b-6b99-4871-a256-29c6a26838fa tempest-GroupsTest-1476531542 None] Group tempest-GroupsTest-Group-886134307: created successfully
Sep 30 18:00:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2680a97b-6b99-4871-a256-29c6a26838fa tempest-GroupsTest-1476531542 None] Create group completed successfully.
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Flow 'volume_create_manager' (db5ded26-f944-4bf6-8a61-96b4e592e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163b75d3-4382-4724-88f3-2db75dfe2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163b75d3-4382-4724-88f3-2db75dfe2319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033912125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cdc0aa94-9e1c-4582-ba5b-bb3cb7220b46,host='devstack@QuobyteHD#QuobyteHD',id=40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88bbd23c634185abf48f9b1877bde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:04Z,use_quota=True,user_id='d9c85a92605240768f3d3b4e4c39bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b264b6f8-0a2c-436c-8b59-6cec3527e75e),volume_type_id=b264b6f8-0a2c-436c-8b59-6cec3527e75e)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7e0068-043a-47de-84b8-619a0ae57951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7e0068-043a-47de-84b8-619a0ae57951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a52630-2080-46c4-b663-af9ce86a68a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a52630-2080-46c4-b663-af9ce86a68a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb', 'volume_name': 'volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90516faa-6a2b-4b73-88a2-d1238c7ba3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90516faa-6a2b-4b73-88a2-d1238c7ba3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fadd74d-33b9-4acc-95ca-a38793e36bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:04 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Volume 40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb', 'volume_size': 1}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cdc0aa94-9e1c-4582-ba5b-bb3cb7220b46,created_at=2026-09-30T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033912125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cdc0aa94-9e1c-4582-ba5b-bb3cb7220b46,host='devstack@QuobyteHD#QuobyteHD',id=40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88bbd23c634185abf48f9b1877bde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:04Z,use_quota=True,user_id='d9c85a92605240768f3d3b4e4c39bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b264b6f8-0a2c-436c-8b59-6cec3527e75e),volume_type_id=b264b6f8-0a2c-436c-8b59-6cec3527e75e)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Creating volume 40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:00:04 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:04 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb 1073741824
Sep 30 18:00:04 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Acquiring lock "cinder-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Lock "cinder-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Acquiring lock "cinder-quobyte-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Lock "cinder-quobyte-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9fdf3f-8e52-4999-b9fa-56476c5af062]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:05 devstack sudo[98891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a
Sep 30 18:00:05 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:05 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb 1073741824" returned: 0 in 0.594s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:05 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb
Sep 30 18:00:05 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:05 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a" returned: 0 in 0.413s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:05 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a
Sep 30 18:00:05 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:05 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fadd74d-33b9-4acc-95ca-a38793e36bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bfeedf-8eb6-41c0-8294-802cb9f7127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Volume volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb (40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb): created successfully
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bfeedf-8eb6-41c0-8294-802cb9f7127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Flow 'volume_create_manager' (db5ded26-f944-4bf6-8a61-96b4e592e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-24606cdf-27a7-4878-bc34-648fd3c30397 tempest-GroupsTest-1476531542 None] Created volume successfully.
Sep 30 18:00:05 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a" returned: 0 in 0.328s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Lock "cinder-quobyte-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a" released by "delete_volume" :: held 0.813s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Created reservations ['fcc676e5-d846-4b00-a4e8-61fcd5effa4b', '8ee95907-bf86-47ed-9b69-c8525f2ad03b', '76697ed4-fd2d-459f-b667-3710e1ba9ef4', '938b17c9-8b18-4ccf-bf18-d58466907438'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:05 devstack sudo[98913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:05 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:06 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Deleted volume successfully.
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f797e1a4-2202-430b-93c9-b978c5082eb3 tempest-VolumesListTestJSON-237816726 None] Lock "cinder-69e9dceb-f29d-4ef2-98fc-93bd1fdab34a-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Acquiring lock "cinder-7f58abe7-684d-484f-9e5f-5ac435af5e0a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Lock "cinder-7f58abe7-684d-484f-9e5f-5ac435af5e0a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Acquiring lock "cinder-quobyte-7f58abe7-684d-484f-9e5f-5ac435af5e0a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Lock "cinder-quobyte-7f58abe7-684d-484f-9e5f-5ac435af5e0a" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9145bfc5-6e74-4b4c-b4f9-d718b91f3f94]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:06 devstack sudo[98916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a
Sep 30 18:00:06 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:06 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a" returned: 0 in 0.390s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:06 devstack sudo[98922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a
Sep 30 18:00:06 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:07 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7f58abe7-684d-484f-9e5f-5ac435af5e0a" returned: 0 in 0.302s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Lock "cinder-quobyte-7f58abe7-684d-484f-9e5f-5ac435af5e0a" released by "delete_volume" :: held 0.743s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "cinder-41471bd4-8d15-416e-a341-be1eece742c8-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-41471bd4-8d15-416e-a341-be1eece742c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Created reservations ['eab3fa1a-a401-41bf-806a-c5463380cea2', 'd14c6047-b59d-43ca-8296-098c87539c19', 'cf481300-d785-41dc-babe-c6d36ca4a11f', '302ce0ed-91fd-4036-a31d-ca8c8ecbd45d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "cinder-quobyte-41471bd4-8d15-416e-a341-be1eece742c8" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-quobyte-41471bd4-8d15-416e-a341-be1eece742c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[779cc11a-2b6f-401d-ba6c-bdf4c45d4a5b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:07 devstack sudo[98925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:07 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:07 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8
Sep 30 18:00:07 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Flow 'volume_create_manager' (e6d663be-cf6d-4d31-8a10-6451b13f6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b426d9de-05c0-4684-9748-48ead20c3372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b426d9de-05c0-4684-9748-48ead20c3372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1413259017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cdc0aa94-9e1c-4582-ba5b-bb3cb7220b46,host='devstack@QuobyteHD#QuobyteHD',id=7c0d08b8-fba7-4e63-9d8f-794b6370ec1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88bbd23c634185abf48f9b1877bde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:07Z,use_quota=True,user_id='d9c85a92605240768f3d3b4e4c39bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b264b6f8-0a2c-436c-8b59-6cec3527e75e),volume_type_id=b264b6f8-0a2c-436c-8b59-6cec3527e75e)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c6b11e-200b-4377-85e0-cf9bcb82e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c6b11e-200b-4377-85e0-cf9bcb82e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ca1bd1-9ce8-4997-a35b-d59b8a2548e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ca1bd1-9ce8-4997-a35b-d59b8a2548e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0d08b8-fba7-4e63-9d8f-794b6370ec1b', 'volume_name': 'volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc8e48f-31b4-42af-babc-bb1ac1ff516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc8e48f-31b4-42af-babc-bb1ac1ff516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f20be3a-0a0e-41c1-9f21-9068f684bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:07 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Volume 7c0d08b8-fba7-4e63-9d8f-794b6370ec1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b', 'volume_size': 1}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cdc0aa94-9e1c-4582-ba5b-bb3cb7220b46,created_at=2026-09-30T16:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1413259017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cdc0aa94-9e1c-4582-ba5b-bb3cb7220b46,host='devstack@QuobyteHD#QuobyteHD',id=7c0d08b8-fba7-4e63-9d8f-794b6370ec1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88bbd23c634185abf48f9b1877bde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:07Z,use_quota=True,user_id='d9c85a92605240768f3d3b4e4c39bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b264b6f8-0a2c-436c-8b59-6cec3527e75e),volume_type_id=b264b6f8-0a2c-436c-8b59-6cec3527e75e)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Creating volume 7c0d08b8-fba7-4e63-9d8f-794b6370ec1b {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:07 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:00:07 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Acquiring lock "cinder-54107516-5ade-415d-af26-e39a560e8495-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.359s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:07 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b 1073741824
Sep 30 18:00:07 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Deleted volume successfully.
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Lock "cinder-54107516-5ade-415d-af26-e39a560e8495-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-373d71a3-7652-4031-b3eb-fb285b606e1d tempest-VolumesListTestJSON-237816726 None] Lock "cinder-7f58abe7-684d-484f-9e5f-5ac435af5e0a-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Acquiring lock "cinder-quobyte-54107516-5ade-415d-af26-e39a560e8495" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Lock "cinder-quobyte-54107516-5ade-415d-af26-e39a560e8495" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:07 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8" returned: 0 in 0.455s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9529410-ef42-43fe-af01-162b0e164a1f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:07 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8
Sep 30 18:00:07 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:07 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495
Sep 30 18:00:07 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:08 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-41471bd4-8d15-416e-a341-be1eece742c8" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-quobyte-41471bd4-8d15-416e-a341-be1eece742c8" released by "delete_volume" :: held 0.808s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Created reservations ['8794c542-66d4-4d7c-88d3-875c2f8026ad', '8fbf0ef2-dc8a-40db-84ad-b31f64b1a473', '0685dfba-f82b-4fe4-9ff9-b1da8f6af291', 'b3bd25d9-a227-4cfe-8d6c-ba3816b7b720'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:08 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b 1073741824" returned: 0 in 0.490s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:08 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495" returned: 0 in 0.404s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:08 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b
Sep 30 18:00:08 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:08 devstack sudo[98948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495
Sep 30 18:00:08 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:08 devstack sudo[98951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:08 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "cinder-44c79096-7fc0-4927-97b9-cfc6ba0e3e60-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-44c79096-7fc0-4927-97b9-cfc6ba0e3e60-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "cinder-quobyte-44c79096-7fc0-4927-97b9-cfc6ba0e3e60" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-quobyte-44c79096-7fc0-4927-97b9-cfc6ba0e3e60" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[695107f5-3809-42e4-abd0-b28d132f25ea]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:08 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-54107516-5ade-415d-af26-e39a560e8495" returned: 0 in 0.321s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Lock "cinder-quobyte-54107516-5ade-415d-af26-e39a560e8495" released by "delete_volume" :: held 0.791s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:08 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b" returned: 0 in 0.411s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:08 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.339s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Deleted volume successfully.
Sep 30 18:00:08 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60
Sep 30 18:00:08 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f20be3a-0a0e-41c1-9f21-9068f684bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d9a6b0-dcc3-4d49-bc1c-53d0b842bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Volume volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b (7c0d08b8-fba7-4e63-9d8f-794b6370ec1b): created successfully
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d9a6b0-dcc3-4d49-bc1c-53d0b842bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Flow 'volume_create_manager' (e6d663be-cf6d-4d31-8a10-6451b13f6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-23cde6a0-bcf8-41cc-b970-38dc93563694 tempest-GroupsTest-1476531542 None] Created volume successfully.
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Created reservations ['cabea372-1c9f-4024-83b6-de56300d9a3c', 'a06d93e4-97fa-455b-9371-85ef68cdaae9', 'cd832690-a6b8-480f-bf9d-8ca1735e4f1e', '6b6e914d-b2a9-484b-9463-0bcdd926df25'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eedef5ce-4d35-4a95-afe2-ebb1db373a44 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-41471bd4-8d15-416e-a341-be1eece742c8-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:08 devstack sudo[98965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:08 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:09 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60" returned: 0 in 0.498s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:09 devstack sudo[98972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60
Sep 30 18:00:09 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:09 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.265s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Deleted volume successfully.
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65910a8d-b770-4abb-a0e3-cf0eeece5abb tempest-VolumesListTestJSON-237816726 None] Lock "cinder-54107516-5ade-415d-af26-e39a560e8495-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:09 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-44c79096-7fc0-4927-97b9-cfc6ba0e3e60" returned: 0 in 0.294s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-quobyte-44c79096-7fc0-4927-97b9-cfc6ba0e3e60" released by "delete_volume" :: held 0.864s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Created reservations ['48a0f5cf-54d6-4da3-b120-00c2e732c828', '7c3411c0-fc22-4ebe-9722-a5c421faee5a', '7bf46f1d-46f4-45e4-83ff-d8f49e91ff0b', '8a24f89e-24b2-47b3-ae91-7b752449177a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:09 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:09 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-c20ca97d-86b1-4bbd-93d7-52d0ca3b6096 req-cdaf95b8-2c3b-481f-b6cf-3a8bb458ea61 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-c20ca97d-86b1-4bbd-93d7-52d0ca3b6096 req-cdaf95b8-2c3b-481f-b6cf-3a8bb458ea61 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-c20ca97d-86b1-4bbd-93d7-52d0ca3b6096 req-cdaf95b8-2c3b-481f-b6cf-3a8bb458ea61 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-c20ca97d-86b1-4bbd-93d7-52d0ca3b6096 req-cdaf95b8-2c3b-481f-b6cf-3a8bb458ea61 tempest-TestInstancesWithCinderVolumes-1401940338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-0276a969-dfde-4f4d-b751-26fca2dddbd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1345a104-2763-421c-9406-6bc08bf38316', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:00:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-c20ca97d-86b1-4bbd-93d7-52d0ca3b6096 req-cdaf95b8-2c3b-481f-b6cf-3a8bb458ea61 tempest-TestInstancesWithCinderVolumes-1401940338 None] attachment_update completed successfully.
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "cinder-26901325-1bda-4917-92e4-28cac5b03c6e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-26901325-1bda-4917-92e4-28cac5b03c6e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "cinder-quobyte-26901325-1bda-4917-92e4-28cac5b03c6e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:09 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.287s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-quobyte-26901325-1bda-4917-92e4-28cac5b03c6e" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Deleted volume successfully.
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f281f921-9da5-4335-bba3-18a9203c3eb1]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4bbd4e39-498b-400c-bf46-58146b41cec8 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-44c79096-7fc0-4927-97b9-cfc6ba0e3e60-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:09 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e
Sep 30 18:00:09 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8a59931e-aef6-4cbb-8f0f-f02c2715c473 tempest-GroupsTest-1476531542 None] Update group completed successfully.
Sep 30 18:00:10 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e" returned: 0 in 0.548s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:10 devstack sudo[98997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e
Sep 30 18:00:10 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:10 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-26901325-1bda-4917-92e4-28cac5b03c6e" returned: 0 in 0.275s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-quobyte-26901325-1bda-4917-92e4-28cac5b03c6e" released by "delete_volume" :: held 0.890s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Created reservations ['2d8b5b93-ad6e-47f1-a50e-972cb643a1be', 'cd7fa30d-972f-4b02-b079-481c8a483ee1', '3b2a81e5-48e6-484f-bfb7-8ab07e44a253', 'e93e394b-ed65-4fec-be3a-d579fd73e6e8'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:10 devstack sudo[99000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:10 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:11 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:11 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:11 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Deleted volume successfully.
Sep 30 18:00:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-19e251c9-d2e6-417e-9144-66dbe0ad6e33 tempest-AttachVolumeTestJSON-1438487512 None] Lock "cinder-26901325-1bda-4917-92e4-28cac5b03c6e-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:11 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-230347e8-b2e2-4509-9d4d-1b7a0d6e25db tempest-GroupsTest-1476531542 None] Update group completed successfully.
Sep 30 18:00:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-da2695e0-41aa-4443-88c1-b902753106b1 req-63367ca8-da76-4ee6-8709-efe4154e6d7f tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-da2695e0-41aa-4443-88c1-b902753106b1 req-63367ca8-da76-4ee6-8709-efe4154e6d7f tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-da2695e0-41aa-4443-88c1-b902753106b1 req-63367ca8-da76-4ee6-8709-efe4154e6d7f tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-da2695e0-41aa-4443-88c1-b902753106b1 req-63367ca8-da76-4ee6-8709-efe4154e6d7f tempest-TestInstancesWithCinderVolumes-1401940338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50e35a44-4cc5-4183-a140-3f8260c37ac8', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:00:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-da2695e0-41aa-4443-88c1-b902753106b1 req-63367ca8-da76-4ee6-8709-efe4154e6d7f tempest-TestInstancesWithCinderVolumes-1401940338 None] attachment_update completed successfully.
Sep 30 18:00:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Acquiring lock "cinder-quobyte-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Lock "cinder-quobyte-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c355826-ab1a-4498-8e70-66a017e71c91]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:13 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb
Sep 30 18:00:13 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:14 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb" returned: 0 in 0.512s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:14 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb
Sep 30 18:00:14 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:14 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Lock "cinder-quobyte-40d3b1dc-bc6e-4ec4-90f6-9970637ee3cb" released by "delete_volume" :: held 0.879s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Acquiring lock "cinder-quobyte-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Lock "cinder-quobyte-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[710968a6-5cf7-430b-ae03-23603729a9d6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:14 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b
Sep 30 18:00:14 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Flow 'volume_create_manager' (1d93b6f7-2ee0-4942-9706-b622fc0ca5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2b8e6b-d18b-4925-955d-9c830d60892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2b8e6b-d18b-4925-955d-9c830d60892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1779680995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e030a93d9519416a908fba9e94919c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:15Z,use_quota=True,user_id='4a40ae19768c4f9485028440210867d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa627f0-2db4-49e2-afc3-40e8f43df905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa627f0-2db4-49e2-afc3-40e8f43df905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a4c7f0-2a07-4102-82ed-2585c5770734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a4c7f0-2a07-4102-82ed-2585c5770734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d', 'volume_name': 'volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b66e43-9e04-46b8-8ebd-cb1aedb5ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b66e43-9e04-46b8-8ebd-cb1aedb5ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9596a46-af2f-4c29-8168-65afae6fe883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:14 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Volume c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d', 'volume_size': 1}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1779680995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e030a93d9519416a908fba9e94919c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:15Z,use_quota=True,user_id='4a40ae19768c4f9485028440210867d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Creating volume c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:00:14 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:14 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d 1073741824
Sep 30 18:00:14 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:14 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b" returned: 0 in 0.461s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:14 devstack sudo[99048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b
Sep 30 18:00:14 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:15 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:15 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b" returned: 0 in 0.386s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d 1073741824" returned: 0 in 0.624s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Lock "cinder-quobyte-7c0d08b8-fba7-4e63-9d8f-794b6370ec1b" released by "delete_volume" :: held 0.901s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:15 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d
Sep 30 18:00:15 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Created reservations ['7e200243-46bd-453e-8c81-cbcbc6a314cf'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:15 devstack cinder-volume[87418]: WARNING cinder.quota [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-154830050 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-154830050, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:15 devstack cinder-volume[87418]: WARNING cinder.quota [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-154830050 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-154830050, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Created reservations ['75d14fb5-1eed-4d4e-ac29-3b1b5bd638aa', '032170f9-7edd-4540-9ccf-b7f2d17c6126', '3560dfea-da86-41e6-9c90-890f71a948fa', 'fcea2147-89ab-4edb-a130-fc4149ac0128'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Created reservations ['9d8dc631-8014-4596-a8cd-89de21f84ed2', '0a3371e9-6f66-4803-9657-483ff6213f7f', '07cbab17-642c-4ce3-8c72-36ef728bbb05', '803e8576-74dc-43c6-ac20-858342f8e593'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:15 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d" returned: 0 in 0.384s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9596a46-af2f-4c29-8168-65afae6fe883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf417818-b68f-4667-bbd5-c7aec02e6afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:15 devstack sudo[99061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:15 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:15 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Volume volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d (c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d): created successfully
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf417818-b68f-4667-bbd5-c7aec02e6afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Flow 'volume_create_manager' (1d93b6f7-2ee0-4942-9706-b622fc0ca5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-be9339f4-3e0e-47c2-9669-c3ced4b8c599 tempest-VolumesNegativeTest-1866324861 None] Created volume successfully.
Sep 30 18:00:16 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.369s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:16 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:16 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f3dc0581-debf-4b01-82b6-274a335c3c0e tempest-GroupsTest-1476531542 None] Delete group completed successfully.
Sep 30 18:00:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-4ecfb39f-9048-47c6-83f1-2afdd6cece38 req-57a8eda7-3870-4555-bb60-1e5fe37bce6f tempest-TestInstancesWithCinderVolumes-1401940338 None] Terminate volume connection completed successfully.
Sep 30 18:00:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-4ecfb39f-9048-47c6-83f1-2afdd6cece38 req-57a8eda7-3870-4555-bb60-1e5fe37bce6f tempest-TestInstancesWithCinderVolumes-1401940338 None] Deleting attachment 1345a104-2763-421c-9406-6bc08bf38316. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:00:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "cinder-0276a969-dfde-4f4d-b751-26fca2dddbd3-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-0276a969-dfde-4f4d-b751-26fca2dddbd3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "cinder-quobyte-0276a969-dfde-4f4d-b751-26fca2dddbd3" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-quobyte-0276a969-dfde-4f4d-b751-26fca2dddbd3" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f9ccd4-4877-470b-ae21-3a75f2833cc7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:21 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3
Sep 30 18:00:21 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:22 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3" returned: 0 in 0.532s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:22 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3
Sep 30 18:00:22 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:22 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0276a969-dfde-4f4d-b751-26fca2dddbd3" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-quobyte-0276a969-dfde-4f4d-b751-26fca2dddbd3" released by "delete_volume" :: held 1.117s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:22 devstack cinder-volume[87418]: WARNING cinder.quota [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875271462-1182955427 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875271462-1182955427, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:22 devstack cinder-volume[87418]: WARNING cinder.quota [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875271462-1182955427 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875271462-1182955427, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Created reservations ['b1d2cf87-300e-438e-a311-838cd7cab1e7', '75008038-e8a8-4ec2-b2c4-bb23eb63eefb', 'f9f70908-25f1-471a-9364-de8e07d5a8fc', '8ff3b59d-0b74-4057-a2d3-cebf669d9d36'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:22 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:22 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:23 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:23 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Deleted volume successfully.
Sep 30 18:00:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-28b6b3c0-6a11-4fb8-b34c-260c534cae93 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-0276a969-dfde-4f4d-b751-26fca2dddbd3-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:25 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:00:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Flow 'volume_create_manager' (7874c83d-0369-4d6e-bbb4-bc31c8c0e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa13d01-39a6-4135-897b-c4289e74cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa13d01-39a6-4135-897b-c4289e74cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1903922023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99140f5b-1072-4f99-95db-a6edb3e3f06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83fbf7cf4fa448bafca7e4b801da270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:26Z,use_quota=True,user_id='b8a425e206554f86888248e1d6a44b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab462cc-efbf-49d6-9031-004afab786cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab462cc-efbf-49d6-9031-004afab786cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c17a813-e045-40ef-bbc3-a4727b89a3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c17a813-e045-40ef-bbc3-a4727b89a3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99140f5b-1072-4f99-95db-a6edb3e3f06d', 'volume_name': 'volume-99140f5b-1072-4f99-95db-a6edb3e3f06d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81ad8e6-8c92-4d21-9b32-9ea502ea4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81ad8e6-8c92-4d21-9b32-9ea502ea4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16decc96-b251-4c25-bdf8-749ab046592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Volume 99140f5b-1072-4f99-95db-a6edb3e3f06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99140f5b-1072-4f99-95db-a6edb3e3f06d', 'volume_size': 1}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1903922023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99140f5b-1072-4f99-95db-a6edb3e3f06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83fbf7cf4fa448bafca7e4b801da270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:26Z,use_quota=True,user_id='b8a425e206554f86888248e1d6a44b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Creating volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:00:26 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:26 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d 1073741824
Sep 30 18:00:26 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:26 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d 1073741824" returned: 0 in 0.667s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:26 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d
Sep 30 18:00:26 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-7ce8bd44-5cbb-4b6a-8e82-52a4df19e379 req-cd0c0990-441b-440f-918d-db597dd30ccc tempest-TestInstancesWithCinderVolumes-1401940338 None] Terminate volume connection completed successfully.
Sep 30 18:00:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-7ce8bd44-5cbb-4b6a-8e82-52a4df19e379 req-cd0c0990-441b-440f-918d-db597dd30ccc tempest-TestInstancesWithCinderVolumes-1401940338 None] Deleting attachment 50e35a44-4cc5-4183-a140-3f8260c37ac8. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:00:27 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d" returned: 0 in 0.380s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16decc96-b251-4c25-bdf8-749ab046592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99140f5b-1072-4f99-95db-a6edb3e3f06d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c523fc7-448c-406f-b014-a737544e9edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Volume volume-99140f5b-1072-4f99-95db-a6edb3e3f06d (99140f5b-1072-4f99-95db-a6edb3e3f06d): created successfully
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c523fc7-448c-406f-b014-a737544e9edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Flow 'volume_create_manager' (7874c83d-0369-4d6e-bbb4-bc31c8c0e580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f43784bc-aef2-40eb-8df5-71b835deefd8 tempest-SnapshotsActionsTest-1380082019 None] Created volume successfully.
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "cinder-b9e18817-5816-4365-8d29-81ee8c4ebf7f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-b9e18817-5816-4365-8d29-81ee8c4ebf7f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "cinder-quobyte-b9e18817-5816-4365-8d29-81ee8c4ebf7f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-quobyte-b9e18817-5816-4365-8d29-81ee8c4ebf7f" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e1474b-275a-4f9d-9dc1-54c39fb29b44]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:27 devstack sudo[99245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f
Sep 30 18:00:27 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:28 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f" returned: 0 in 0.679s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:28 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f
Sep 30 18:00:28 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Creating offline snapshot 92f6cfc0-0eff-453a-8d74-d58d9bffe135 of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74d010-3284-499c-acf6-f6e24b24d82a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:28 devstack sudo[99252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d
Sep 30 18:00:28 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:28 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b9e18817-5816-4365-8d29-81ee8c4ebf7f" returned: 0 in 0.631s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-quobyte-b9e18817-5816-4365-8d29-81ee8c4ebf7f" released by "delete_volume" :: held 1.403s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:29 devstack cinder-volume[87418]: WARNING cinder.quota [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72743571-226536531 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72743571-226536531, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:29 devstack cinder-volume[87418]: WARNING cinder.quota [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72743571-226536531 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72743571-226536531, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Created reservations ['2823d0c7-cbf9-4455-be30-a8b9329aa32b', '5aff39b9-f7c7-42b0-806a-88d3ba9ce271', '6997d4b6-413a-48c8-8e63-933b8b2499b7', 'd8cfdd10-1e05-4ba2-a461-2523f509797f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:29 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d" returned: 0 in 0.612s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:29 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:29 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:29 devstack sudo[99263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 1G
Sep 30 18:00:29 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:29 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.491s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Deleted volume successfully.
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5d3fb20-2248-4ea4-944c-84760075af1d tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-b9e18817-5816-4365-8d29-81ee8c4ebf7f-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:29 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 1G" returned: 0 in 0.720s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:29 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:29 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:30 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.453s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:30 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 is being set with open permissions: ugo+rw
Sep 30 18:00:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:30 devstack sudo[99299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:30 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:30 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.294s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:30 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=167,cinder:SELECT=160,cinder:INSERT=41,cinder:DELETE=12 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:00:30 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=176,cinder:UPDATE=191,cinder:INSERT=48,cinder:DELETE=10 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:00:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:30 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info
Sep 30 18:00:30 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:31 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info" returned: 0 in 0.321s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:31 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info is being set with open permissions: ugo+rw
Sep 30 18:00:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:31 devstack sudo[99306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info
Sep 30 18:00:31 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:31 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.info" returned: 0 in 0.319s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3743efa6-6cff-4ea4-be33-375b61337b65 tempest-SnapshotsActionsTest-1380082019 None] Create snapshot completed successfully
Sep 30 18:00:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Creating offline snapshot b9e6ad54-a77e-4529-8069-e0618d488e26 of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:00:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a0124508-cd5a-4f44-8556-35e7db03d5c7 tempest-GroupsV314Test-643355641 None] Group tempest-GroupsV314Test-Group-1493562013: creating
Sep 30 18:00:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e1319-cabc-47d5-acac-c55e9fa7803f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a0124508-cd5a-4f44-8556-35e7db03d5c7 tempest-GroupsV314Test-643355641 None] Group tempest-GroupsV314Test-Group-1493562013: created successfully
Sep 30 18:00:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a0124508-cd5a-4f44-8556-35e7db03d5c7 tempest-GroupsV314Test-643355641 None] Create group completed successfully.
Sep 30 18:00:32 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:32 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:33 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.598s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:33 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 1G
Sep 30 18:00:33 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-cd4d2c4b-016d-478b-8d6c-4fb1683ddc7c req-6d063243-d243-45d6-9574-2a869bd3cbed tempest-TestInstancesWithCinderVolumes-1401940338 None] Terminate volume connection completed successfully.
Sep 30 18:00:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-cd4d2c4b-016d-478b-8d6c-4fb1683ddc7c req-6d063243-d243-45d6-9574-2a869bd3cbed tempest-TestInstancesWithCinderVolumes-1401940338 None] Deleting attachment a5a5d2e7-9743-4e4f-94db-6132f8cdce14. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:00:33 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 1G" returned: 0 in 0.630s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:33 devstack sudo[99352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26
Sep 30 18:00:33 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:34 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26" returned: 0 in 0.461s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:34 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 is being set with open permissions: ugo+rw
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:34 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26
Sep 30 18:00:34 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Flow 'volume_create_manager' (b6b17d1e-a539-4083-991f-30f98953b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cc8f81-e977-41da-a34e-f4dc70003804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cc8f81-e977-41da-a34e-f4dc70003804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330246157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4af3e2de-1790-4d0f-9929-47951d4d0e12,host='devstack@QuobyteHD#QuobyteHD',id=c15872ab-0e1c-43fd-8948-3a0562d70b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35bdd5b4a684d0693c74e63b105d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:35Z,use_quota=True,user_id='204de8bd74974b9e8cc828007e844a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca8a2f6d-0811-4c3d-952f-77a1ffda3713),volume_type_id=ca8a2f6d-0811-4c3d-952f-77a1ffda3713)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2649cd4c-810f-481f-8f56-a28869f6f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2649cd4c-810f-481f-8f56-a28869f6f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c595da4-062a-4637-bf6e-161c9a5be2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c595da4-062a-4637-bf6e-161c9a5be2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15872ab-0e1c-43fd-8948-3a0562d70b3d', 'volume_name': 'volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c889cd96-aa72-43b7-8883-46655f2525d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c889cd96-aa72-43b7-8883-46655f2525d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:34 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32459e5c-b2e1-405d-a27f-a86d8abf05ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Volume c15872ab-0e1c-43fd-8948-3a0562d70b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d', 'volume_size': 1}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26" returned: 0 in 0.291s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4af3e2de-1790-4d0f-9929-47951d4d0e12,created_at=2026-09-30T16:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330246157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4af3e2de-1790-4d0f-9929-47951d4d0e12,host='devstack@QuobyteHD#QuobyteHD',id=c15872ab-0e1c-43fd-8948-3a0562d70b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35bdd5b4a684d0693c74e63b105d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:00:35Z,use_quota=True,user_id='204de8bd74974b9e8cc828007e844a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca8a2f6d-0811-4c3d-952f-77a1ffda3713),volume_type_id=ca8a2f6d-0811-4c3d-952f-77a1ffda3713)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Creating volume c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:00:34 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:34 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d 1073741824
Sep 30 18:00:34 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-32e535aa-2012-4aef-8a19-a933199c122a tempest-SnapshotsActionsTest-1380082019 None] Create snapshot completed successfully
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "cinder-afdd6893-4366-49e2-bbbf-710d4a3d3496-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-afdd6893-4366-49e2-bbbf-710d4a3d3496-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "cinder-quobyte-afdd6893-4366-49e2-bbbf-710d4a3d3496" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-quobyte-afdd6893-4366-49e2-bbbf-710d4a3d3496" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557d835-8cb3-4ce7-be39-991e9d2f3f08]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:35 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496
Sep 30 18:00:35 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:35 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d 1073741824" returned: 0 in 0.541s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:35 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d
Sep 30 18:00:35 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:35 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496" returned: 0 in 0.415s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:35 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496
Sep 30 18:00:35 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:35 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d" returned: 0 in 0.265s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32459e5c-b2e1-405d-a27f-a86d8abf05ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0af679-7d45-48c4-9f56-32c41afb58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:00:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Volume volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d (c15872ab-0e1c-43fd-8948-3a0562d70b3d): created successfully
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0af679-7d45-48c4-9f56-32c41afb58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Flow 'volume_create_manager' (b6b17d1e-a539-4083-991f-30f98953b04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:00:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f86ad4cc-47c1-4d74-950f-fe953c7660d4 tempest-GroupsV314Test-643355641 None] Created volume successfully.
Sep 30 18:00:35 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-afdd6893-4366-49e2-bbbf-710d4a3d3496" returned: 0 in 0.284s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-quobyte-afdd6893-4366-49e2-bbbf-710d4a3d3496" released by "delete_volume" :: held 0.761s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:35 devstack cinder-volume[87418]: WARNING cinder.quota [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1411404101-405052911 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1411404101-405052911, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:35 devstack cinder-volume[87418]: WARNING cinder.quota [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1411404101-405052911 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1411404101-405052911, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Created reservations ['2eb8d24d-d1a1-4780-ae6c-f69245b293c3', '536029c0-5d23-4077-aa28-f192fffcb54a', '64aab2ea-afa2-4de2-b0e6-097ea9517f83', '307cc950-89be-4251-ad09-b8f5f56f4bb7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-b9e6ad54-a77e-4529-8069-e0618d488e26-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-b9e6ad54-a77e-4529-8069-e0618d488e26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-b9e6ad54-a77e-4529-8069-e0618d488e26" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-b9e6ad54-a77e-4529-8069-e0618d488e26" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Deleting offline snapshot b9e6ad54-a77e-4529-8069-e0618d488e26 of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:00:36 devstack sudo[99378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:36 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] snapshot_file for this snap is: volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a334d7-8d71-4030-9b19-20aacaf416d9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:36 devstack sudo[99381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26
Sep 30 18:00:36 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:36 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.299s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Deleted volume successfully.
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e15275b1-ce6f-4fba-bfd4-d2664e259627 tempest-TestInstancesWithCinderVolumes-1401940338 None] Lock "cinder-afdd6893-4366-49e2-bbbf-710d4a3d3496-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:36 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26" returned: 0 in 0.494s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee5ab38-ea92-41c1-ade1-733d4801d162]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:36 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Cloning volume c15872ab-0e1c-43fd-8948-3a0562d70b3d to volume 04c24841-df19-4561-a199-2650b2f19ea7
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Creating offline snapshot cf8b8eee-d90b-4e37-941f-92e6040a6674 of volume c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[994cb106-f9b8-4286-a7f1-464cf586d3ac]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:36 devstack sudo[99387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:36 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:36 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d
Sep 30 18:00:36 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:37 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.583s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:37 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d" returned: 0 in 0.493s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:37 devstack sudo[99398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26
Sep 30 18:00:37 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:37 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 1G
Sep 30 18:00:37 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:37 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26" returned: 0 in 0.482s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:37 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26
Sep 30 18:00:37 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 1G" returned: 0 in 0.549s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:37 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:37 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674
Sep 30 18:00:37 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:37 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.b9e6ad54-a77e-4529-8069-e0618d488e26" returned: 0 in 0.305s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-b9e6ad54-a77e-4529-8069-e0618d488e26" released by "_delete_snapshot" :: held 2.047s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" released by "delete_snapshot" :: held 2.103s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Created reservations ['02b2e589-54f9-4a4f-8cc7-9af9b5be9f2e', '6fe409c8-1ef2-4e6a-9921-766ba13908cc', '2e1d2aaf-7d8c-452d-8784-fe9fabd1bafd', '3143c325-3b1b-415e-b1ef-c40c50537e8f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Delete snapshot completed successfully.
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-629ce56e-efc1-4368-ab80-0c6c499537a8 tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-b9e6ad54-a77e-4529-8069-e0618d488e26-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:38 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674" returned: 0 in 0.488s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:38 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674
Sep 30 18:00:38 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:38 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674" returned: 0 in 0.305s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:38 devstack sudo[99421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info
Sep 30 18:00:38 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:38 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info" returned: 0 in 0.307s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 18:00:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:38 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info
Sep 30 18:00:38 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:39 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.info" returned: 0 in 0.275s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Acquiring lock "cinder-quobyte-04c24841-df19-4561-a199-2650b2f19ea7" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-04c24841-df19-4561-a199-2650b2f19ea7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] snapshot: cf8b8eee-d90b-4e37-941f-92e6040a6674, volume: 04c24841-df19-4561-a199-2650b2f19ea7,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[35231770-cbdd-4894-ba03-edd07068874a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:39 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674
Sep 30 18:00:39 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:39 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674" returned: 0 in 0.491s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26d28a4-0cf9-42bc-893c-cbf0563fcf29]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:39 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d
Sep 30 18:00:39 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:40 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d" returned: 0 in 0.441s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:00:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:00:40 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:00:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:40 devstack sudo[99438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7
Sep 30 18:00:40 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Acquiring lock "cinder-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Lock "cinder-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Acquiring lock "cinder-quobyte-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Lock "cinder-quobyte-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d" acquired by "delete_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:41 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32e5c17-3739-4543-bc8a-66e17b2ab825]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:41 devstack sudo[99456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d
Sep 30 18:00:41 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:42 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d" returned: 0 in 0.796s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:42 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d
Sep 30 18:00:42 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:42 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d" returned: 0 in 0.421s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Lock "cinder-quobyte-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d" released by "delete_volume" :: held 1.313s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:42 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Created reservations ['364996be-7f30-4b4c-b3ad-ec22d10a0d64', 'df53ceb5-54b1-4274-8a2a-7c4730ddad83', '64316c9c-ea3d-4b12-96b4-a548ff2756fa', '2a401058-d29b-4c44-ada0-48690a02a37d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:43 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:43 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:43 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.745s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:43 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Deleted volume successfully.
Sep 30 18:00:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bdca9dcb-1f00-4d6a-a925-0946adcfaa12 tempest-VolumesNegativeTest-1866324861 None] Lock "cinder-c34cfbcb-90e3-48ea-ba60-a115d3ed4e8d-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:46 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:46 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:46 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:00:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:00:49 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7" returned: 0 in 8.897s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d, size 1024.00 MB, duration 8.90 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:00:49 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Converted 1024.00 MB image at 115.08 MB/s
Sep 30 18:00:49 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:49 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7
Sep 30 18:00:49 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:49 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7" returned: 0 in 0.252s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-04c24841-df19-4561-a199-2650b2f19ea7" released by "_copy_volume_from_snapshot" :: held 10.183s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Acquiring lock "cinder-quobyte-cf8b8eee-d90b-4e37-941f-92e6040a6674" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-cf8b8eee-d90b-4e37-941f-92e6040a6674" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Deleting offline snapshot cf8b8eee-d90b-4e37-941f-92e6040a6674 of volume c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] snapshot_file for this snap is: volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8582a599-fc05-479e-bf6d-17b1b37f1bca]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:49 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674
Sep 30 18:00:49 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:50 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674" returned: 0 in 0.545s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2499a4-ce0c-4912-8e58-4a48191fe3bf]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:50 devstack sudo[99520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d
Sep 30 18:00:50 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:50 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d" returned: 0 in 0.620s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:50 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674
Sep 30 18:00:50 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:51 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:51 devstack sudo[99532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674
Sep 30 18:00:51 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:51 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d.cf8b8eee-d90b-4e37-941f-92e6040a6674" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-cf8b8eee-d90b-4e37-941f-92e6040a6674" released by "_delete_snapshot" :: held 1.970s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.782s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.835s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Creating offline snapshot 630adb4f-3040-47c7-bd59-86f68e05efec of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa94227-1a51-46d1-962e-0936f0d320b2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-27b7e502-a816-4e41-aca1-1d8f0bf9ad2d tempest-GroupsV314Test-643355641 None] Create group from source-group-4af3e2de-1790-4d0f-9929-47951d4d0e12 completed successfully.
Sep 30 18:00:51 devstack sudo[99535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:51 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:52 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.461s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:52 devstack sudo[99540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec 1G
Sep 30 18:00:52 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:52 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec 1G" returned: 0 in 0.527s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:52 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec
Sep 30 18:00:52 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:53 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec" returned: 0 in 0.463s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:53 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec is being set with open permissions: ugo+rw
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:53 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec
Sep 30 18:00:53 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:53 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Acquiring lock "cinder-quobyte-04c24841-df19-4561-a199-2650b2f19ea7" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-04c24841-df19-4561-a199-2650b2f19ea7" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:53 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a6783aac-520e-47ca-96c8-71092e60d0a2 tempest-SnapshotsActionsTest-1380082019 None] Create snapshot completed successfully
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf0342c-3a98-4255-83a2-d85b428b4d43]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:53 devstack sudo[99554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7
Sep 30 18:00:53 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:53 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7" returned: 0 in 0.395s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:53 devstack sudo[99559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7
Sep 30 18:00:53 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:54 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-04c24841-df19-4561-a199-2650b2f19ea7" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-04c24841-df19-4561-a199-2650b2f19ea7" released by "delete_volume" :: held 0.739s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Created reservations ['2538634f-7332-426c-b235-a387200c8316'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:54 devstack cinder-volume[87418]: WARNING cinder.quota [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1741057433 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1741057433, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:54 devstack cinder-volume[87418]: WARNING cinder.quota [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1741057433 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1741057433, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Created reservations ['2f529e56-252d-4d21-a688-745f703729f1', '4963e803-5a39-4b43-8b88-b3065a0d203d', '7c50274b-21fd-450b-9748-b0846f245f2f', 'bebf443a-dfad-44eb-98a3-6c7469b087e2'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:54 devstack sudo[99562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:54 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-630adb4f-3040-47c7-bd59-86f68e05efec-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-630adb4f-3040-47c7-bd59-86f68e05efec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-630adb4f-3040-47c7-bd59-86f68e05efec" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-630adb4f-3040-47c7-bd59-86f68e05efec" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Deleting offline snapshot 630adb4f-3040-47c7-bd59-86f68e05efec of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] snapshot_file for this snap is: volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab4ffe-a5c7-4181-93ad-dcd9d4a3e8e5]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:54 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.398s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:54 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ffcf8012-5d81-4ba6-9b20-37008849321e tempest-GroupsV314Test-643355641 None] Delete group completed successfully.
Sep 30 18:00:55 devstack sudo[99565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec
Sep 30 18:00:55 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Acquiring lock "cinder-quobyte-c15872ab-0e1c-43fd-8948-3a0562d70b3d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-c15872ab-0e1c-43fd-8948-3a0562d70b3d" acquired by "delete_volume" :: waited 0.047s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab601e-e0ee-4612-a85e-781643c347dc]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:55 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d
Sep 30 18:00:55 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:55 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec" returned: 0 in 0.531s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7868051e-2a82-4ae5-8800-2650dd7e584d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:55 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:55 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:55 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d" returned: 0 in 0.499s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:55 devstack sudo[99578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d
Sep 30 18:00:55 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:56 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.531s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:56 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec
Sep 30 18:00:56 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:56 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c15872ab-0e1c-43fd-8948-3a0562d70b3d" returned: 0 in 0.436s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Lock "cinder-quobyte-c15872ab-0e1c-43fd-8948-3a0562d70b3d" released by "delete_volume" :: held 1.053s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Created reservations ['dabec322-57de-4eb8-8c57-d36bbde4b23a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Created reservations ['3b029229-3123-42d9-a425-3561876e25f9', '2c51af86-81c4-4511-964a-390099a668f5', '62107c62-bdf4-45b6-b1be-1fd5136ff67d', '006f7532-c9e4-4fd2-873e-5fd6a1eb5d7d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:56 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:00:56 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:56 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec" returned: 0 in 0.594s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:56 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec
Sep 30 18:00:56 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:56 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.328s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:00:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7cbf5ed3-b0a0-427d-8520-e6ecedafdc05 tempest-GroupsV314Test-643355641 None] Delete group completed successfully.
Sep 30 18:00:56 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.630adb4f-3040-47c7-bd59-86f68e05efec" returned: 0 in 0.315s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-630adb4f-3040-47c7-bd59-86f68e05efec" released by "_delete_snapshot" :: held 2.155s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" released by "delete_snapshot" :: held 2.196s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:57 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Created reservations ['b34c2b7f-1841-45ad-ad76-147baa7d021f', '1c94ace9-5390-4d39-aed2-890326ca9ade', '7ced7c3a-ef16-4306-b6dc-0dd67303fcf6', '68b8290b-fadd-4763-8a62-988ad84e48da'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:00:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Delete snapshot completed successfully.
Sep 30 18:00:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f25a9d25-a299-4791-bb23-7281f21b27fb tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-630adb4f-3040-47c7-bd59-86f68e05efec-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:00:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:00:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:00:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Creating offline snapshot 53c2f206-126e-453a-8b00-b866d1c31b0b of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:00:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf88a36-496c-4e00-a517-b926ae5615fc]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:00:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:58 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:00:58 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:58 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.443s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:59 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b 1G
Sep 30 18:00:59 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:59 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b 1G" returned: 0 in 0.567s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:59 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b
Sep 30 18:00:59 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:00:59 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:00:59 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b is being set with open permissions: ugo+rw
Sep 30 18:00:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:00:59 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b
Sep 30 18:00:59 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:00 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b" returned: 0 in 0.258s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-30c89e70-28ce-4d1b-9609-d709c905b886 tempest-SnapshotsActionsTest-1380082019 None] Create snapshot completed successfully
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-53c2f206-126e-453a-8b00-b866d1c31b0b-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-53c2f206-126e-453a-8b00-b866d1c31b0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-53c2f206-126e-453a-8b00-b866d1c31b0b" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-53c2f206-126e-453a-8b00-b866d1c31b0b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Deleting offline snapshot 53c2f206-126e-453a-8b00-b866d1c31b0b of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] snapshot_file for this snap is: volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ae2046-c70f-404d-a2c5-c0b8c686456c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:01 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b
Sep 30 18:01:01 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:01 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b" returned: 0 in 0.495s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8707014-44b1-464f-afe0-0fea2d192335]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:01 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:01:01 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:01 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.461s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:01 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b
Sep 30 18:01:01 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (f91062ea-2206-4e50-a3cd-7b9c38daca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a012bd6-b5b5-47c0-803d-8b50c8cf34d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a012bd6-b5b5-47c0-803d-8b50c8cf34d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1699300134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574d3999-0522-4852-9dfb-f8199a614c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:02Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441ac399-3201-4003-ba7b-e1f1934f522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441ac399-3201-4003-ba7b-e1f1934f522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c093c6a-c697-4e0d-bb3c-7b4c56a28ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c093c6a-c697-4e0d-bb3c-7b4c56a28ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574d3999-0522-4852-9dfb-f8199a614c9e', 'volume_name': 'volume-574d3999-0522-4852-9dfb-f8199a614c9e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080001df-3c80-4cea-aace-a2eb38ea906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080001df-3c80-4cea-aace-a2eb38ea906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f47fd77-b5e0-421e-ab2d-f5a4fe1fae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:02 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Volume 574d3999-0522-4852-9dfb-f8199a614c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574d3999-0522-4852-9dfb-f8199a614c9e', 'volume_size': 1}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1699300134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574d3999-0522-4852-9dfb-f8199a614c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:02Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Creating volume 574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:02 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:02 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b" returned: 0 in 0.670s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:02 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e 1073741824
Sep 30 18:01:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:02 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:02 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b
Sep 30 18:01:02 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:02 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.53c2f206-126e-453a-8b00-b866d1c31b0b" returned: 0 in 0.425s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-53c2f206-126e-453a-8b00-b866d1c31b0b" released by "_delete_snapshot" :: held 2.219s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" released by "delete_snapshot" :: held 2.249s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Created reservations ['88003e3a-d668-4a1a-84fc-241f2b286632', '4abc3bd8-71f2-40e7-9984-a9034e1812f8', '0bcc2fd4-683e-44f2-aa29-4a268a9af3d7', '702cc7e5-fe07-4b15-a60b-3296f0e8fcad'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:03 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e 1073741824" returned: 0 in 0.639s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Delete snapshot completed successfully.
Sep 30 18:01:03 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e
Sep 30 18:01:03 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9371e09d-5800-44d5-8695-936301607fcd tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-53c2f206-126e-453a-8b00-b866d1c31b0b-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:03 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e" returned: 0 in 0.292s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f47fd77-b5e0-421e-ab2d-f5a4fe1fae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574d3999-0522-4852-9dfb-f8199a614c9e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d94fec6-bdc9-4a92-8ce2-4073f3605090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:03 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Volume volume-574d3999-0522-4852-9dfb-f8199a614c9e (574d3999-0522-4852-9dfb-f8199a614c9e): created successfully
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d94fec6-bdc9-4a92-8ce2-4073f3605090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (f91062ea-2206-4e50-a3cd-7b9c38daca50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dc7f5ef3-0600-435f-b212-49ed7f5bc65b tempest-VolumesSnapshotTestJSON-997606718 None] Created volume successfully.
Sep 30 18:01:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Creating offline snapshot ffe00169-c40a-4b97-bc35-0df9fa85483a of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:01:04 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2e6bf-f026-4f39-827a-3c741f77f828]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:04 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:01:04 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:05 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.623s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:05 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a 1G
Sep 30 18:01:05 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:05 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a 1G" returned: 0 in 0.589s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:05 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a
Sep 30 18:01:05 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:06 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a" returned: 0 in 0.470s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:06 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a is being set with open permissions: ugo+rw
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:06 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a
Sep 30 18:01:06 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:06 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a" returned: 0 in 0.362s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.482s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Creating offline snapshot a9349574-aca9-4ff1-8b57-811b1dc285d1 of volume 574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:01:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-662d2d06-4d40-41a8-a6cb-b2a5ae939953 tempest-SnapshotsActionsTest-1380082019 None] Create snapshot completed successfully
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699de00-0053-4b23-b0a0-c8252630d5f8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:06 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e
Sep 30 18:01:06 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:07 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e" returned: 0 in 0.589s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:07 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 1G
Sep 30 18:01:07 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-ffe00169-c40a-4b97-bc35-0df9fa85483a-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-ffe00169-c40a-4b97-bc35-0df9fa85483a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Acquiring lock "cinder-quobyte-ffe00169-c40a-4b97-bc35-0df9fa85483a" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-ffe00169-c40a-4b97-bc35-0df9fa85483a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Deleting offline snapshot ffe00169-c40a-4b97-bc35-0df9fa85483a of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] snapshot_file for this snap is: volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:01:07 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 1G" returned: 0 in 0.507s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574d3999-0522-4852-9dfb-f8199a614c9e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f59aa-1d2a-44f3-baf0-85221ede274d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:07 devstack sudo[99681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574d3999-0522-4852-9dfb-f8199a614c9e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1
Sep 30 18:01:07 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:07 devstack sudo[99682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a
Sep 30 18:01:07 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:08 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574d3999-0522-4852-9dfb-f8199a614c9e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1" returned: 0 in 0.353s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:08 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 is being set with open permissions: ugo+rw
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:08 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1
Sep 30 18:01:08 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:08 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a" returned: 0 in 0.438s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38e3efd-642a-486d-aa08-3827b15fe903]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:08 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:01:08 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:08 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1" returned: 0 in 0.296s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:08 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info
Sep 30 18:01:08 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:08 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.444s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:08 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a
Sep 30 18:01:08 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:08 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info" returned: 0 in 0.363s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:08 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info is being set with open permissions: ugo+rw
Sep 30 18:01:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:08 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info
Sep 30 18:01:08 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:09 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.info" returned: 0 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9a91d901-400b-4246-9b66-210b37c827e4 tempest-VolumesSnapshotTestJSON-997606718 None] Create snapshot completed successfully
Sep 30 18:01:09 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a" returned: 0 in 0.637s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:09 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a
Sep 30 18:01:09 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:09 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.ffe00169-c40a-4b97-bc35-0df9fa85483a" returned: 0 in 0.371s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-ffe00169-c40a-4b97-bc35-0df9fa85483a" released by "_delete_snapshot" :: held 2.036s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" released by "delete_snapshot" :: held 2.065s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Created reservations ['88644684-fd74-45a4-9988-f7418e4389ec', 'ee5e4e46-3a91-4b71-a40a-c9a67770288e', '7d42ec34-ee04-48a5-a59c-f19fd89a09de', 'eb644997-57c8-49fe-86cc-e8fc99b1cf57'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Delete snapshot completed successfully.
Sep 30 18:01:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d72cc24e-cccc-4437-a700-5615aa1b321c tempest-SnapshotsActionsTest-1635346663 None] Lock "cinder-ffe00169-c40a-4b97-bc35-0df9fa85483a-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-a9349574-aca9-4ff1-8b57-811b1dc285d1-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-a9349574-aca9-4ff1-8b57-811b1dc285d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-574d3999-0522-4852-9dfb-f8199a614c9e" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-574d3999-0522-4852-9dfb-f8199a614c9e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-a9349574-aca9-4ff1-8b57-811b1dc285d1" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-a9349574-aca9-4ff1-8b57-811b1dc285d1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Deleting offline snapshot a9349574-aca9-4ff1-8b57-811b1dc285d1 of volume 574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] snapshot_file for this snap is: volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7658d51e-19ec-4a0b-bd8f-094fbc158d16]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:10 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1
Sep 30 18:01:10 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:11 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1" returned: 0 in 0.474s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574d3999-0522-4852-9dfb-f8199a614c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8466063-c06a-4e79-bfab-15bf557d9c97]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:11 devstack sudo[99719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e
Sep 30 18:01:11 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "cinder-92f6cfc0-0eff-453a-8d74-d58d9bffe135-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-92f6cfc0-0eff-453a-8d74-d58d9bffe135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "cinder-quobyte-92f6cfc0-0eff-453a-8d74-d58d9bffe135" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-quobyte-92f6cfc0-0eff-453a-8d74-d58d9bffe135" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Deleting offline snapshot 92f6cfc0-0eff-453a-8d74-d58d9bffe135 of volume 99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] snapshot_file for this snap is: volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640cf07-e955-4065-94cf-2f2d496fb9ff]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:11 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e" returned: 0 in 0.574s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:11 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:01:11 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:11 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1
Sep 30 18:01:11 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:12 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.436s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99140f5b-1072-4f99-95db-a6edb3e3f06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419376a-b58c-4503-a1f5-ddc6363908e0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:12 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1" returned: 0 in 0.480s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:12 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1
Sep 30 18:01:12 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:12 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d
Sep 30 18:01:12 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:12 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e.a9349574-aca9-4ff1-8b57-811b1dc285d1" returned: 0 in 0.333s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:12 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d" returned: 0 in 0.471s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-a9349574-aca9-4ff1-8b57-811b1dc285d1" released by "_delete_snapshot" :: held 2.036s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-574d3999-0522-4852-9dfb-f8199a614c9e" released by "delete_snapshot" :: held 2.062s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:12 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:01:12 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['f94ef703-1e17-48a4-b44d-ae284518841f', '50b6f1f4-49a1-4114-878b-4fd1cac044e9', 'cb6f4919-8f02-434e-a74a-687d7cb8a0ac', '4a9bd258-fcb9-4099-abd5-11bd19654ecd'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Delete snapshot completed successfully.
Sep 30 18:01:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f31efb5f-1a28-4007-8608-533b95a9a7a2 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-a9349574-aca9-4ff1-8b57-811b1dc285d1-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:13 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.472s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:13 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135
Sep 30 18:01:13 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:13 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d.92f6cfc0-0eff-453a-8d74-d58d9bffe135" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-quobyte-92f6cfc0-0eff-453a-8d74-d58d9bffe135" released by "_delete_snapshot" :: held 1.826s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" released by "delete_snapshot" :: held 1.866s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Created reservations ['4813b7de-b3a9-4a7d-aa7e-b89d10dd376d', '3e510c31-7e98-4ba0-ac71-e2df587d7c7d', 'a60c9735-5427-49e9-b2e9-dd26d76cc51f', 'ac22b528-cbb3-418d-b1f1-7a7d14894161'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Delete snapshot completed successfully.
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fbfdc4d-39f1-481d-a329-11c1afeaad49 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-92f6cfc0-0eff-453a-8d74-d58d9bffe135-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "cinder-99140f5b-1072-4f99-95db-a6edb3e3f06d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-99140f5b-1072-4f99-95db-a6edb3e3f06d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1770b7b-4a21-4a9a-bc01-2a7798d7fd5d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:14 devstack sudo[99754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d
Sep 30 18:01:14 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:14 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d" returned: 0 in 0.477s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:14 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d
Sep 30 18:01:14 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (e3654461-3810-466e-a37d-6e17223e3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1ab974-9034-4ee7-8d1d-d469ffcba033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1ab974-9034-4ee7-8d1d-d469ffcba033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-497482564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d112d2-1e7c-4c19-a596-7d905ed49923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:15Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63270382-6657-4ea4-86b3-04ff84b7ea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63270382-6657-4ea4-86b3-04ff84b7ea79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5555e171-8487-4777-a13c-58e467faea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5555e171-8487-4777-a13c-58e467faea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d112d2-1e7c-4c19-a596-7d905ed49923', 'volume_name': 'volume-63d112d2-1e7c-4c19-a596-7d905ed49923', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c76c142-fa80-454e-aa3d-4f413ce361c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c76c142-fa80-454e-aa3d-4f413ce361c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aed7958-41cb-4af1-bf07-b44ed6046ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:14 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Volume 63d112d2-1e7c-4c19-a596-7d905ed49923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d112d2-1e7c-4c19-a596-7d905ed49923', 'volume_size': 1}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-497482564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d112d2-1e7c-4c19-a596-7d905ed49923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:15Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Creating volume 63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:14 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:14 devstack sudo[99762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 1073741824
Sep 30 18:01:14 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:14 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99140f5b-1072-4f99-95db-a6edb3e3f06d" returned: 0 in 0.346s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-quobyte-99140f5b-1072-4f99-95db-a6edb3e3f06d" released by "delete_volume" :: held 0.932s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Created reservations ['32986288-cbc1-4e98-952a-ff777831957b', '523438ad-82df-419e-9f03-5f4511c456ac', '9b6ae965-ff7b-42ce-9bf0-1061a558b34c', '38ae3bfd-36c2-42cd-bfd3-057e5e748c76'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:15 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:15 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:15 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 1073741824" returned: 0 in 0.537s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:15 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.318s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Deleted volume successfully.
Sep 30 18:01:15 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923
Sep 30 18:01:15 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f61e0598-0ec6-4e4f-8603-2a877db94af8 tempest-SnapshotsActionsTest-1380082019 None] Lock "cinder-99140f5b-1072-4f99-95db-a6edb3e3f06d-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:15 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923" returned: 0 in 0.275s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aed7958-41cb-4af1-bf07-b44ed6046ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d112d2-1e7c-4c19-a596-7d905ed49923', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b160b4-a642-491e-9324-725e43f82a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:15 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Volume volume-63d112d2-1e7c-4c19-a596-7d905ed49923 (63d112d2-1e7c-4c19-a596-7d905ed49923): created successfully
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b160b4-a642-491e-9324-725e43f82a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (e3654461-3810-466e-a37d-6e17223e3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-901411fc-016d-491e-97b4-314a872ab1cc tempest-VolumesSnapshotTestJSON-997606718 None] Created volume successfully.
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Creating offline snapshot 738bd293-197c-490e-8855-4e050545bb4a of volume 63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b238253c-2b0c-4c5d-8b75-c09189abff64]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:17 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923
Sep 30 18:01:17 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:17 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923" returned: 0 in 0.530s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:17 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a 1G
Sep 30 18:01:17 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:18 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a 1G" returned: 0 in 0.680s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d112d2-1e7c-4c19-a596-7d905ed49923 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:18 devstack sudo[99791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d112d2-1e7c-4c19-a596-7d905ed49923 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a
Sep 30 18:01:18 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:18 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d112d2-1e7c-4c19-a596-7d905ed49923 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:18 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a is being set with open permissions: ugo+rw
Sep 30 18:01:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:18 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a
Sep 30 18:01:18 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:19 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a" returned: 0 in 0.383s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:19 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info
Sep 30 18:01:19 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:19 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:19 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info is being set with open permissions: ugo+rw
Sep 30 18:01:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:19 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info
Sep 30 18:01:19 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:19 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.info" returned: 0 in 0.288s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ddd888b0-7486-48e1-9efe-1cd421a27b2c tempest-VolumesSnapshotTestJSON-997606718 None] Create snapshot completed successfully
Sep 30 18:01:20 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (afed281b-1431-413d-a58b-b3606a4d91c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8917dad-c75a-4a93-bea8-6898046be569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8917dad-c75a-4a93-bea8-6898046be569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337521514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a185719-c6c2-4eac-b036-1c2267e1de8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=738bd293-197c-490e-8855-4e050545bb4a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:21Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76ced10-eb10-4421-8a5e-304ec02eee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76ced10-eb10-4421-8a5e-304ec02eee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c8bce2-fc07-4865-a0a9-cddeb0d905f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c8bce2-fc07-4865-a0a9-cddeb0d905f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a185719-c6c2-4eac-b036-1c2267e1de8a', 'volume_name': 'volume-4a185719-c6c2-4eac-b036-1c2267e1de8a', 'volume_size': 2, 'snapshot_id': '738bd293-197c-490e-8855-4e050545bb4a'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0514a7-1a7f-4276-89ba-825afefca1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0514a7-1a7f-4276-89ba-825afefca1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495083d2-4d12-46da-8d1e-c6d43f47551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Volume 4a185719-c6c2-4eac-b036-1c2267e1de8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a185719-c6c2-4eac-b036-1c2267e1de8a', 'volume_size': 2, 'snapshot_id': '738bd293-197c-490e-8855-4e050545bb4a'}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-738bd293-197c-490e-8855-4e050545bb4a-4a185719-c6c2-4eac-b036-1c2267e1de8a" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-738bd293-197c-490e-8855-4e050545bb4a-4a185719-c6c2-4eac-b036-1c2267e1de8a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Creating volume 4a185719-c6c2-4eac-b036-1c2267e1de8a from snapshot 738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-4a185719-c6c2-4eac-b036-1c2267e1de8a" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-4a185719-c6c2-4eac-b036-1c2267e1de8a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] snapshot: 738bd293-197c-490e-8855-4e050545bb4a, volume: 4a185719-c6c2-4eac-b036-1c2267e1de8a,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f58c6-f3b8-4fa1-94cf-ee98386b8c4d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:21 devstack sudo[99805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a
Sep 30 18:01:21 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:21 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a" returned: 0 in 0.435s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d112d2-1e7c-4c19-a596-7d905ed49923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3602572-c137-4bba-9fa6-4cb314f4555a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:21 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923
Sep 30 18:01:21 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:22 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923" returned: 0 in 0.505s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:01:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:01:22 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:01:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:22 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a
Sep 30 18:01:22 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Flow 'volume_create_manager' (74fcabbd-afa5-4a3c-b856-e6a7c629aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa63221-a55c-4154-82ec-8b885a2c1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa63221-a55c-4154-82ec-8b885a2c1b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-498313189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5b406e-2e37-46a1-825f-5a5b3ad28e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef1073ed35c4743af1efb0e410f127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:28Z,use_quota=True,user_id='2c4074c753394aa68d97097baee33621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbed0406-f80c-4a95-ab5a-99a078c15c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbed0406-f80c-4a95-ab5a-99a078c15c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f28d5a-2992-46db-964d-2c476ae99fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f28d5a-2992-46db-964d-2c476ae99fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5b406e-2e37-46a1-825f-5a5b3ad28e1e', 'volume_name': 'volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70211679-37fd-4434-8e0a-23d03795e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70211679-37fd-4434-8e0a-23d03795e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521d8c04-2d5c-444f-9813-75535aef4e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Volume 5f5b406e-2e37-46a1-825f-5a5b3ad28e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e', 'volume_size': 1}
Sep 30 18:01:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Flow 'volume_create_manager' (c6f9fc5a-61da-482a-9502-ac70731220fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cf8e95-56a3-473b-a8ed-e7d6060e8d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cf8e95-56a3-473b-a8ed-e7d6060e8d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-220109535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a506c7c4-a9ea-40f2-8d52-063f84e88d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49297e21fb3346a99bab42912cca8657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:30Z,use_quota=True,user_id='b093ac2a0aeb45a48afc482901420308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37272d82-c030-429a-aa0c-a8d91775cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37272d82-c030-429a-aa0c-a8d91775cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f24fdbb-a512-4595-a323-a8ae2cc6af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f24fdbb-a512-4595-a323-a8ae2cc6af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a506c7c4-a9ea-40f2-8d52-063f84e88d72', 'volume_name': 'volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e18d1-6144-47a3-a53c-92212b70f16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e18d1-6144-47a3-a53c-92212b70f16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e1b00b-390b-4fb3-b088-736ee0a57cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:30 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Volume a506c7c4-a9ea-40f2-8d52-063f84e88d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72', 'volume_size': 1}
Sep 30 18:01:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:30 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a" returned: 0 in 8.723s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:01:31 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Converted 1024.00 MB image at 117.33 MB/s
Sep 30 18:01:31 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a is being set with open permissions: ugo+rw
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:31 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a
Sep 30 18:01:31 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=108,cinder:UPDATE=108,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=103,cinder:UPDATE=98,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:31 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Flow 'volume_create_manager' (e5e83551-1a33-4f8d-9293-ce0c4aac4da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14111cc0-5cf5-411f-9486-2e77257870ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a" returned: 0 in 0.342s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14111cc0-5cf5-411f-9486-2e77257870ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1897585579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0cbd4d-b46d-4526-a9d2-67b217c45d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc8ca9a06064eae803a2f38ae3a0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:31Z,use_quota=True,user_id='ccb4bcfdf33d406fba1423e44cdab190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8929ce84-8855-4226-acdb-4a8d8cc88d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8929ce84-8855-4226-acdb-4a8d8cc88d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6a42c8-fab6-49e8-9381-b2bb0f6b5489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6a42c8-fab6-49e8-9381-b2bb0f6b5489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0cbd4d-b46d-4526-a9d2-67b217c45d45', 'volume_name': 'volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d79f853-ef62-4f23-9f1b-2005709a302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d79f853-ef62-4f23-9f1b-2005709a302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d80e7b-b805-41a9-a524-dff277fd7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Volume 7b0cbd4d-b46d-4526-a9d2-67b217c45d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45', 'volume_size': 1}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-4a185719-c6c2-4eac-b036-1c2267e1de8a" released by "_copy_volume_from_snapshot" :: held 10.193s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-738bd293-197c-490e-8855-4e050545bb4a-4a185719-c6c2-4eac-b036-1c2267e1de8a" released by "_create_volume_from_snapshot" :: held 10.265s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.281s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-498313189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5b406e-2e37-46a1-825f-5a5b3ad28e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef1073ed35c4743af1efb0e410f127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:28Z,use_quota=True,user_id='2c4074c753394aa68d97097baee33621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Creating volume 5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:31 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:31 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e 1073741824
Sep 30 18:01:31 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495083d2-4d12-46da-8d1e-c6d43f47551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a185719-c6c2-4eac-b036-1c2267e1de8a', 'volume_size': 2, 'snapshot_id': '738bd293-197c-490e-8855-4e050545bb4a'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375da789-6d48-4473-a601-932f6fcc0f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Volume volume-4a185719-c6c2-4eac-b036-1c2267e1de8a (4a185719-c6c2-4eac-b036-1c2267e1de8a): created successfully
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375da789-6d48-4473-a601-932f6fcc0f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (afed281b-1431-413d-a58b-b3606a4d91c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f221a499-969f-4021-be5a-b42439870407 tempest-VolumesSnapshotTestJSON-997606718 None] Created volume successfully.
Sep 30 18:01:31 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e 1073741824" returned: 0 in 0.483s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:32 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e
Sep 30 18:01:32 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:32 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" returned: 0 in 0.291s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.871s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-220109535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a506c7c4-a9ea-40f2-8d52-063f84e88d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49297e21fb3346a99bab42912cca8657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:30Z,use_quota=True,user_id='b093ac2a0aeb45a48afc482901420308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Creating volume a506c7c4-a9ea-40f2-8d52-063f84e88d72 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:32 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521d8c04-2d5c-444f-9813-75535aef4e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92db128-b3dc-4888-a9ee-3de14193b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:32 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Volume volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e (5f5b406e-2e37-46a1-825f-5a5b3ad28e1e): created successfully
Sep 30 18:01:32 devstack sudo[99846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 1073741824
Sep 30 18:01:32 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92db128-b3dc-4888-a9ee-3de14193b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Flow 'volume_create_manager' (74fcabbd-afa5-4a3c-b856-e6a7c629aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d4d86a6a-6c2d-4453-9d2b-cd3829c137d9 tempest-TestStampPattern-1947875384 None] Created volume successfully.
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-4a185719-c6c2-4eac-b036-1c2267e1de8a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-4a185719-c6c2-4eac-b036-1c2267e1de8a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-4a185719-c6c2-4eac-b036-1c2267e1de8a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-4a185719-c6c2-4eac-b036-1c2267e1de8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ac77d8-a48a-4733-b031-7a818d266be1]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:32 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a
Sep 30 18:01:32 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:32 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 1073741824" returned: 0 in 0.613s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:33 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72
Sep 30 18:01:33 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:33 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a" returned: 0 in 0.495s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:33 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a
Sep 30 18:01:33 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:33 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72" returned: 0 in 0.289s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1897585579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0cbd4d-b46d-4526-a9d2-67b217c45d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc8ca9a06064eae803a2f38ae3a0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:31Z,use_quota=True,user_id='ccb4bcfdf33d406fba1423e44cdab190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Creating volume 7b0cbd4d-b46d-4526-a9d2-67b217c45d45 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:33 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:33 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 1073741824
Sep 30 18:01:33 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e1b00b-390b-4fb3-b088-736ee0a57cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366c3c8-a02b-49c4-97e1-9a2aa16ddfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:33 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Volume volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 (a506c7c4-a9ea-40f2-8d52-063f84e88d72): created successfully
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366c3c8-a02b-49c4-97e1-9a2aa16ddfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Flow 'volume_create_manager' (c6f9fc5a-61da-482a-9502-ac70731220fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5318b0da-a8e3-4cd9-abbe-73f61f68155a tempest-VolumeQuotasAdminTestJSON-499421829 None] Created volume successfully.
Sep 30 18:01:33 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a185719-c6c2-4eac-b036-1c2267e1de8a" returned: 0 in 0.328s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-4a185719-c6c2-4eac-b036-1c2267e1de8a" released by "delete_volume" :: held 0.883s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['d0a73dcf-bbe5-4f52-9522-ec55c1ec3402', '32025867-8727-4012-8863-f16b646bf967', '718e41c3-d3a5-4110-bb5c-86e611f7cffc', 'ec197de0-a492-460a-94cb-f880d3a17137'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:33 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:33 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-738bd293-197c-490e-8855-4e050545bb4a-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-738bd293-197c-490e-8855-4e050545bb4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-63d112d2-1e7c-4c19-a596-7d905ed49923" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-63d112d2-1e7c-4c19-a596-7d905ed49923" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-738bd293-197c-490e-8855-4e050545bb4a" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-738bd293-197c-490e-8855-4e050545bb4a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Deleting offline snapshot 738bd293-197c-490e-8855-4e050545bb4a of volume 63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:01:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] snapshot_file for this snap is: volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:01:33 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a1a81c-7c04-4532-8da7-1c908910cbf0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:34 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 1073741824" returned: 0 in 0.733s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.422s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Deleted volume successfully.
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a81b09a6-eb23-44e7-bc08-57b4ff383941 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-4a185719-c6c2-4eac-b036-1c2267e1de8a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:34 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45
Sep 30 18:01:34 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:34 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a
Sep 30 18:01:34 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:34 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45" returned: 0 in 0.273s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d80e7b-b805-41a9-a524-dff277fd7709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c455f0-ecec-4d01-8f0d-ca50f3aa9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:34 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a" returned: 0 in 0.375s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d112d2-1e7c-4c19-a596-7d905ed49923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Volume volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 (7b0cbd4d-b46d-4526-a9d2-67b217c45d45): created successfully
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c455f0-ecec-4d01-8f0d-ca50f3aa9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Flow 'volume_create_manager' (e5e83551-1a33-4f8d-9293-ce0c4aac4da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[911cbc3d-e188-4234-b6a7-1e5a36a23025]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-962a49a0-03c7-4316-9c22-d3150cb60348 tempest-VolumesServicesTestJSON-1609369983 None] Created volume successfully.
Sep 30 18:01:34 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923
Sep 30 18:01:34 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "cinder-a506c7c4-a9ea-40f2-8d52-063f84e88d72-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Acquiring lock "cinder-7b0cbd4d-b46d-4526-a9d2-67b217c45d45-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "cinder-a506c7c4-a9ea-40f2-8d52-063f84e88d72-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Lock "cinder-7b0cbd4d-b46d-4526-a9d2-67b217c45d45-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "cinder-quobyte-a506c7c4-a9ea-40f2-8d52-063f84e88d72" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Acquiring lock "cinder-quobyte-7b0cbd4d-b46d-4526-a9d2-67b217c45d45" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "cinder-quobyte-a506c7c4-a9ea-40f2-8d52-063f84e88d72" acquired by "delete_volume" :: waited 0.051s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Lock "cinder-quobyte-7b0cbd4d-b46d-4526-a9d2-67b217c45d45" acquired by "delete_volume" :: waited 0.061s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76e403-ff41-4414-977e-87a4430ace06]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e112e22-558f-41bb-9b61-4e4d076c1b39]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:35 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72
Sep 30 18:01:35 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:35 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923" returned: 0 in 0.732s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:35 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45
Sep 30 18:01:35 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:35 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a
Sep 30 18:01:35 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:35 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72" returned: 0 in 0.462s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:35 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72
Sep 30 18:01:35 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45" returned: 0 in 0.471s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:35 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45
Sep 30 18:01:35 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:35 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a" returned: 0 in 0.423s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:35 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a
Sep 30 18:01:35 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:35 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a506c7c4-a9ea-40f2-8d52-063f84e88d72" returned: 0 in 0.296s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "cinder-quobyte-a506c7c4-a9ea-40f2-8d52-063f84e88d72" released by "delete_volume" :: held 0.840s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7b0cbd4d-b46d-4526-a9d2-67b217c45d45" returned: 0 in 0.327s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:35 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Lock "cinder-quobyte-7b0cbd4d-b46d-4526-a9d2-67b217c45d45" released by "delete_volume" :: held 0.885s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:35 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923.738bd293-197c-490e-8855-4e050545bb4a" returned: 0 in 0.359s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Created reservations ['6cfd5000-9e52-4a1f-bf8f-594522ad91d6', '2ca7196c-5b1b-48f0-a61f-59465758edc3', '7f4d12aa-07e6-4bb2-a3bc-97a201e67f5e', '78423ee0-6ecd-4a7e-9d17-126ea5cb9680'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-738bd293-197c-490e-8855-4e050545bb4a" released by "_delete_snapshot" :: held 2.204s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-63d112d2-1e7c-4c19-a596-7d905ed49923" released by "delete_snapshot" :: held 2.249s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Created reservations ['7414391b-1ed2-4adf-b15b-8ab459b13b1c', 'be48cde1-a39f-410b-9fcc-33d0253728f1', '7bd1cacf-0c67-436a-8f37-b1f12369eeb7', 'a4d5e5f0-3381-4a8b-b2fd-e7e45aa40f92'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:36 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:36 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['0980f735-fa18-456c-bfb0-7a63ec8bfe72', '21c32f43-4e1d-4152-9a4f-a66c868196e7', 'f8505f54-3bba-4196-875e-fb8ed8cf89ba', '5ae80017-748f-44e3-adce-e7e572afb10c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:36 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:36 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Delete snapshot completed successfully.
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6523ae0-404b-413b-9b10-f971705f0b10 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-738bd293-197c-490e-8855-4e050545bb4a-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:36 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.499s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Deleted volume successfully.
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-604654b2-c54e-4745-90cb-20314d025d6f tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "cinder-a506c7c4-a9ea-40f2-8d52-063f84e88d72-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:36 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.513s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Deleted volume successfully.
Sep 30 18:01:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc6e04fb-1f7f-4e7f-a53e-b836d80e1c9c tempest-VolumesServicesTestJSON-1609369983 None] Lock "cinder-7b0cbd4d-b46d-4526-a9d2-67b217c45d45-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-63d112d2-1e7c-4c19-a596-7d905ed49923-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-63d112d2-1e7c-4c19-a596-7d905ed49923-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-63d112d2-1e7c-4c19-a596-7d905ed49923" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-63d112d2-1e7c-4c19-a596-7d905ed49923" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e71e76-9091-4af1-b7ea-708abc60b5e7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:37 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923
Sep 30 18:01:37 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:37 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923" returned: 0 in 0.474s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:38 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923
Sep 30 18:01:38 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Flow 'volume_create_manager' (38be4d64-1a14-4443-ae70-0986d45fbdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f713eb4c-b5bc-4486-904e-65e558479f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f713eb4c-b5bc-4486-904e-65e558479f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1611841829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9367ced8-63d8-4f3d-a78a-88e940420efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49297e21fb3346a99bab42912cca8657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:38Z,use_quota=True,user_id='b093ac2a0aeb45a48afc482901420308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c607ba49-8529-40c4-bb01-6c127356ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c607ba49-8529-40c4-bb01-6c127356ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dd7edf-b888-449a-906e-178dd574439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dd7edf-b888-449a-906e-178dd574439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9367ced8-63d8-4f3d-a78a-88e940420efc', 'volume_name': 'volume-9367ced8-63d8-4f3d-a78a-88e940420efc', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec521ddb-7f24-4134-abeb-1a52091e9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec521ddb-7f24-4134-abeb-1a52091e9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0cfa85-0782-4257-b01d-ad319e0e8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:38 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Volume 9367ced8-63d8-4f3d-a78a-88e940420efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9367ced8-63d8-4f3d-a78a-88e940420efc', 'volume_size': 1}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1611841829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9367ced8-63d8-4f3d-a78a-88e940420efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49297e21fb3346a99bab42912cca8657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:38Z,use_quota=True,user_id='b093ac2a0aeb45a48afc482901420308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Creating volume 9367ced8-63d8-4f3d-a78a-88e940420efc {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:38 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:38 devstack sudo[100022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc 1073741824
Sep 30 18:01:38 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:38 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-63d112d2-1e7c-4c19-a596-7d905ed49923" returned: 0 in 0.443s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-63d112d2-1e7c-4c19-a596-7d905ed49923" released by "delete_volume" :: held 1.046s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['dd6cd44d-6910-4a02-a6be-1a0ac6d52c70', '594de5a8-c119-4741-8ad9-f97a58aec232', 'b310903f-c3ea-4c70-8a46-36940fc68d70', '947d7d0f-cc9b-4477-bf91-2f3242c99ad4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:38 devstack sudo[100028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:38 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:38 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc 1073741824" returned: 0 in 0.734s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:39 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.508s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:39 devstack sudo[100034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc
Sep 30 18:01:39 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Deleted volume successfully.
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e0b09741-3ba7-4ba7-acd3-32542ad80c73 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-63d112d2-1e7c-4c19-a596-7d905ed49923-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:39 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc" returned: 0 in 0.397s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0cfa85-0782-4257-b01d-ad319e0e8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9367ced8-63d8-4f3d-a78a-88e940420efc', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a0cb7c-22c4-4298-849f-abceb85df0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:39 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Volume volume-9367ced8-63d8-4f3d-a78a-88e940420efc (9367ced8-63d8-4f3d-a78a-88e940420efc): created successfully
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a0cb7c-22c4-4298-849f-abceb85df0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Flow 'volume_create_manager' (38be4d64-1a14-4443-ae70-0986d45fbdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e9601b04-52ed-4009-8dc0-e83f6d5c33fb tempest-VolumeQuotasAdminTestJSON-499421829 None] Created volume successfully.
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (0b422c53-394d-45ca-af99-9ecda4951b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7061694-79e8-40b5-b03b-5caff140da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7061694-79e8-40b5-b03b-5caff140da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-429595755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ec1bec-43a7-4572-836d-e7284d47a211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:40Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2bba54-50e7-42f8-9594-d30c16aff00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2bba54-50e7-42f8-9594-d30c16aff00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c46a7b-1af7-4345-a4ac-bc01ca695e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c46a7b-1af7-4345-a4ac-bc01ca695e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ec1bec-43a7-4572-836d-e7284d47a211', 'volume_name': 'volume-20ec1bec-43a7-4572-836d-e7284d47a211', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee45c3eb-da03-478c-88e1-4342f7b2f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee45c3eb-da03-478c-88e1-4342f7b2f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341b2d91-2305-40cd-8a86-61dc2b65045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:40 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Volume 20ec1bec-43a7-4572-836d-e7284d47a211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ec1bec-43a7-4572-836d-e7284d47a211', 'volume_size': 1}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-429595755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ec1bec-43a7-4572-836d-e7284d47a211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:40Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Creating volume 20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:40 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:40 devstack sudo[100037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 1073741824
Sep 30 18:01:40 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:41 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 1073741824" returned: 0 in 0.779s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:41 devstack sudo[100049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211
Sep 30 18:01:41 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-01a29710-9303-4afb-a02b-e84afe0a17d7 tempest-VolumeQuotasAdminTestJSON-1107469263 None] Transfer volume completed successfully.
Sep 30 18:01:41 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211" returned: 0 in 0.572s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:01:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341b2d91-2305-40cd-8a86-61dc2b65045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ec1bec-43a7-4572-836d-e7284d47a211', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd8a885-4719-423a-b977-3a831e686739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:42 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Volume volume-20ec1bec-43a7-4572-836d-e7284d47a211 (20ec1bec-43a7-4572-836d-e7284d47a211): created successfully
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd8a885-4719-423a-b977-3a831e686739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (0b422c53-394d-45ca-af99-9ecda4951b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7e8446aa-f44e-458a-b256-295a1fac2611 tempest-VolumesSnapshotTestJSON-997606718 None] Created volume successfully.
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Acquiring lock "cinder-9367ced8-63d8-4f3d-a78a-88e940420efc-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Lock "cinder-9367ced8-63d8-4f3d-a78a-88e940420efc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Acquiring lock "cinder-quobyte-9367ced8-63d8-4f3d-a78a-88e940420efc" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Lock "cinder-quobyte-9367ced8-63d8-4f3d-a78a-88e940420efc" acquired by "delete_volume" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dab4fd-d008-421d-9f27-7cf6e3bd8639]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:42 devstack sudo[100052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc
Sep 30 18:01:42 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Creating offline snapshot 42275094-be28-47cc-b8d0-aa963e148fa1 of volume 20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590644a-4388-4b66-b007-feb11ed05a29]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:43 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc" returned: 0 in 0.594s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:43 devstack sudo[100054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211
Sep 30 18:01:43 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:43 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc
Sep 30 18:01:43 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:43 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211" returned: 0 in 0.527s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:43 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9367ced8-63d8-4f3d-a78a-88e940420efc" returned: 0 in 0.370s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:43 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 1G
Sep 30 18:01:43 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Lock "cinder-quobyte-9367ced8-63d8-4f3d-a78a-88e940420efc" released by "delete_volume" :: held 1.065s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Created reservations ['289acb04-afcd-4cd6-bbc5-e34bb0656683', 'ade136c9-bcea-4a12-81a0-dc703c11d2ba', '74ce0394-f9bb-47ac-a982-350bc222c5b1', '80a90190-04e2-40b9-995b-4d91f75cae27'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:43 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:43 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:44 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 1G" returned: 0 in 0.825s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ec1bec-43a7-4572-836d-e7284d47a211 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:44 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.432s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Deleted volume successfully.
Sep 30 18:01:44 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ec1bec-43a7-4572-836d-e7284d47a211 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1
Sep 30 18:01:44 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aec2d3dc-72b0-46fd-a2e7-765ab15308fb tempest-VolumeQuotasAdminTestJSON-1928994110 None] Lock "cinder-9367ced8-63d8-4f3d-a78a-88e940420efc-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:44 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ec1bec-43a7-4572-836d-e7284d47a211 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1" returned: 0 in 0.556s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:44 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 is being set with open permissions: ugo+rw
Sep 30 18:01:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:44 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1
Sep 30 18:01:44 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:45 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1" returned: 0 in 0.579s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:45 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info
Sep 30 18:01:45 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:45 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info" returned: 0 in 0.455s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:45 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info is being set with open permissions: ugo+rw
Sep 30 18:01:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:46 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info
Sep 30 18:01:46 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:46 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.info" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:46 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:01:46 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.587s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:46 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-70995246-85ed-4abf-8f80-09fc106db81e tempest-VolumesSnapshotTestJSON-997606718 None] Create snapshot completed successfully
Sep 30 18:01:46 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.432s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:01:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (48164e1d-4f02-4286-96f4-afef9f2d39fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6cbd73-4b9e-465d-baec-ad6722ad817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6cbd73-4b9e-465d-baec-ad6722ad817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2062054024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6774684-9e1e-47ab-bece-5c597376e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71d8823b454d38aac7a60397f0ceb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42275094-be28-47cc-b8d0-aa963e148fa1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:48Z,use_quota=True,user_id='afa96ba673e045a581889ae19b0f5b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a30a17-de6a-4908-8bb1-424e3541854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a30a17-de6a-4908-8bb1-424e3541854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa299765-859f-455a-a817-d1271129ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa299765-859f-455a-a817-d1271129ae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6774684-9e1e-47ab-bece-5c597376e2ed', 'volume_name': 'volume-a6774684-9e1e-47ab-bece-5c597376e2ed', 'volume_size': 1, 'snapshot_id': '42275094-be28-47cc-b8d0-aa963e148fa1'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a3084b-7cc5-4b2b-9879-0af9295d36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a3084b-7cc5-4b2b-9879-0af9295d36f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ced51b-e294-4aa6-9ad3-c13baa3df147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Volume a6774684-9e1e-47ab-bece-5c597376e2ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6774684-9e1e-47ab-bece-5c597376e2ed', 'volume_size': 1, 'snapshot_id': '42275094-be28-47cc-b8d0-aa963e148fa1'}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-42275094-be28-47cc-b8d0-aa963e148fa1-a6774684-9e1e-47ab-bece-5c597376e2ed" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-42275094-be28-47cc-b8d0-aa963e148fa1-a6774684-9e1e-47ab-bece-5c597376e2ed" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Creating volume a6774684-9e1e-47ab-bece-5c597376e2ed from snapshot 42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-a6774684-9e1e-47ab-bece-5c597376e2ed" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-a6774684-9e1e-47ab-bece-5c597376e2ed" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] snapshot: 42275094-be28-47cc-b8d0-aa963e148fa1, volume: a6774684-9e1e-47ab-bece-5c597376e2ed,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0361de-840c-4a49-b8d4-be1c16f3e686]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:48 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1
Sep 30 18:01:48 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:49 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1" returned: 0 in 0.634s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ec1bec-43a7-4572-836d-e7284d47a211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb0d06f-9cb0-4d3b-b417-1dc7fb04df60]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:49 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211
Sep 30 18:01:49 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:49 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211" returned: 0 in 0.436s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:01:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:49 devstack sudo[100153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed
Sep 30 18:01:49 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:58 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed" returned: 0 in 8.627s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:01:58 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Converted 1024.00 MB image at 118.69 MB/s
Sep 30 18:01:58 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed is being set with open permissions: ugo+rw
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:58 devstack sudo[100187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed
Sep 30 18:01:58 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=77,cinder:SELECT=37,cinder:DELETE=8,cinder:INSERT=12 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=54,cinder:UPDATE=50,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:01:58 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed" returned: 0 in 0.264s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-a6774684-9e1e-47ab-bece-5c597376e2ed" released by "_copy_volume_from_snapshot" :: held 10.108s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-42275094-be28-47cc-b8d0-aa963e148fa1-a6774684-9e1e-47ab-bece-5c597376e2ed" released by "_create_volume_from_snapshot" :: held 10.195s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.218s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ced51b-e294-4aa6-9ad3-c13baa3df147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6774684-9e1e-47ab-bece-5c597376e2ed', 'volume_size': 1, 'snapshot_id': '42275094-be28-47cc-b8d0-aa963e148fa1'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21ef14d-8605-46e8-9583-2d3a7cdfc027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Volume volume-a6774684-9e1e-47ab-bece-5c597376e2ed (a6774684-9e1e-47ab-bece-5c597376e2ed): created successfully
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21ef14d-8605-46e8-9583-2d3a7cdfc027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Flow 'volume_create_manager' (48164e1d-4f02-4286-96f4-afef9f2d39fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-937464d6-5a24-4596-a16b-5cfb0854c4e6 tempest-VolumesSnapshotTestJSON-997606718 None] Created volume successfully.
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Flow 'volume_create_manager' (2986c023-3f25-47a7-98fe-2f6e3b6edd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d412ab-ff4d-47a1-b7ce-222be63b004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d412ab-ff4d-47a1-b7ce-222be63b004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-481231576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043a3abe-107a-463c-b954-2beb43735746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065951df55a44f93859f11894b4b22dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:59Z,use_quota=True,user_id='0737f8ae007d4772907eac545b1a7845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af7d46e-9e72-46b0-af7d-4cba0f548aa2),volume_type_id=8af7d46e-9e72-46b0-af7d-4cba0f548aa2)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cd1026-51dd-45f8-9765-4b99e09f5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cd1026-51dd-45f8-9765-4b99e09f5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6747d591-7fd6-443d-8acd-9fbf01d44c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6747d591-7fd6-443d-8acd-9fbf01d44c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043a3abe-107a-463c-b954-2beb43735746', 'volume_name': 'volume-043a3abe-107a-463c-b954-2beb43735746', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5923d5-25da-4b88-a8de-5862327ad5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5923d5-25da-4b88-a8de-5862327ad5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d5ca88-c594-4a8f-ba39-3539c738edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:01:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Volume 043a3abe-107a-463c-b954-2beb43735746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043a3abe-107a-463c-b954-2beb43735746', 'volume_size': 1}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-481231576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043a3abe-107a-463c-b954-2beb43735746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065951df55a44f93859f11894b4b22dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:01:59Z,use_quota=True,user_id='0737f8ae007d4772907eac545b1a7845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af7d46e-9e72-46b0-af7d-4cba0f548aa2),volume_type_id=8af7d46e-9e72-46b0-af7d-4cba0f548aa2)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Creating volume 043a3abe-107a-463c-b954-2beb43735746 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:01:58 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:01:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:59 devstack sudo[100190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746 1073741824
Sep 30 18:01:59 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-a6774684-9e1e-47ab-bece-5c597376e2ed-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-a6774684-9e1e-47ab-bece-5c597376e2ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-a6774684-9e1e-47ab-bece-5c597376e2ed" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-a6774684-9e1e-47ab-bece-5c597376e2ed" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d0b86-fe20-4e4d-a45b-7434f1f97304]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:59 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746 1073741824" returned: 0 in 0.612s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:01:59 devstack sudo[100196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746
Sep 30 18:01:59 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:59 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed
Sep 30 18:01:59 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:01:59 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed" returned: 0 in 0.480s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:01:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:00 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746" returned: 0 in 0.373s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:00 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed
Sep 30 18:02:00 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d5ca88-c594-4a8f-ba39-3539c738edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043a3abe-107a-463c-b954-2beb43735746', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95a40f6-4cce-4439-857b-3ff0a63f7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:00 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Volume volume-043a3abe-107a-463c-b954-2beb43735746 (043a3abe-107a-463c-b954-2beb43735746): created successfully
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95a40f6-4cce-4439-857b-3ff0a63f7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Flow 'volume_create_manager' (2986c023-3f25-47a7-98fe-2f6e3b6edd5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3ce9d468-9888-4da0-a346-8a80145f9154 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Created volume successfully.
Sep 30 18:02:00 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a6774684-9e1e-47ab-bece-5c597376e2ed" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-a6774684-9e1e-47ab-bece-5c597376e2ed" released by "delete_volume" :: held 0.778s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['14ba00eb-95e5-49b7-8703-c80d9433b3e8', 'fa7ee98c-6b82-416a-833c-c4aa18f9169a', '3720df91-6d76-4263-9245-a6fe698f9fec', '0868649c-62f4-4680-8f88-d11472f74e4f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:00 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:00 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-42275094-be28-47cc-b8d0-aa963e148fa1-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:00 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.285s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-42275094-be28-47cc-b8d0-aa963e148fa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-20ec1bec-43a7-4572-836d-e7284d47a211" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Deleted volume successfully.
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-20ec1bec-43a7-4572-836d-e7284d47a211" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-42275094-be28-47cc-b8d0-aa963e148fa1" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bed39540-37dd-4e58-9538-a7253200f66a tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-a6774684-9e1e-47ab-bece-5c597376e2ed-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-42275094-be28-47cc-b8d0-aa963e148fa1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Deleting offline snapshot 42275094-be28-47cc-b8d0-aa963e148fa1 of volume 20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] snapshot_file for this snap is: volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[640093e9-55c7-4070-8b5e-cdceb82c8cab]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:00 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1
Sep 30 18:02:00 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:01 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1" returned: 0 in 0.404s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ec1bec-43a7-4572-836d-e7284d47a211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[681eea73-fbeb-4420-9f24-332fd0b16f2f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:01 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211
Sep 30 18:02:01 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:01 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:01 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:01 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7f9a4a11-5325-4500-babd-ef581948fc61 tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Retype volume completed successfully.
Sep 30 18:02:01 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211" returned: 0 in 0.625s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:01 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1
Sep 30 18:02:01 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:02 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1" returned: 0 in 0.364s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:02 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1
Sep 30 18:02:02 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:02 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211.42275094-be28-47cc-b8d0-aa963e148fa1" returned: 0 in 0.296s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-42275094-be28-47cc-b8d0-aa963e148fa1" released by "_delete_snapshot" :: held 1.837s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-20ec1bec-43a7-4572-836d-e7284d47a211" released by "delete_snapshot" :: held 1.862s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['50264dac-f5e7-408e-ba91-f32f8f9fd3c4', '869c7acc-80bf-4140-a4cd-dde73aee32c1', '58eba3a8-e783-4fd0-94c8-98202bf3f69f', '713e7c60-761f-4495-a665-45cc1c62bc81'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Acquiring lock "cinder-043a3abe-107a-463c-b954-2beb43735746-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "cinder-043a3abe-107a-463c-b954-2beb43735746-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Delete snapshot completed successfully.
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fa3b2e0-05e8-484e-89b1-75b25c7773e6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-42275094-be28-47cc-b8d0-aa963e148fa1-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Acquiring lock "cinder-quobyte-043a3abe-107a-463c-b954-2beb43735746" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "cinder-quobyte-043a3abe-107a-463c-b954-2beb43735746" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd4b42-7fba-46e9-aada-52d8ef852d6e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-20ec1bec-43a7-4572-836d-e7284d47a211-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-20ec1bec-43a7-4572-836d-e7284d47a211-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:02 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746
Sep 30 18:02:02 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-20ec1bec-43a7-4572-836d-e7284d47a211" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-20ec1bec-43a7-4572-836d-e7284d47a211" acquired by "delete_volume" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6e5e8-8dc9-416c-840f-9f1905796941]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:03 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211
Sep 30 18:02:03 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:03 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746" returned: 0 in 0.440s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:03 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746
Sep 30 18:02:03 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:03 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211" returned: 0 in 0.386s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:03 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211
Sep 30 18:02:03 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:03 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-043a3abe-107a-463c-b954-2beb43735746" returned: 0 in 0.247s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "cinder-quobyte-043a3abe-107a-463c-b954-2beb43735746" released by "delete_volume" :: held 0.743s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:03 devstack cinder-volume[87418]: WARNING cinder.quota [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:02:03 devstack cinder-volume[87418]: WARNING cinder.quota [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Created reservations ['a74172a5-f975-4d1c-b59d-408fdb34e503', '77ce4958-853d-4c4d-991d-c42e65b1ac85', '67ba55fe-67c4-48ed-86ba-f6cd60a9b346', '78c8f1ca-5838-4f0a-9319-939307ee01d3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:03 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:03 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:03 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-20ec1bec-43a7-4572-836d-e7284d47a211" returned: 0 in 0.276s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-20ec1bec-43a7-4572-836d-e7284d47a211" released by "delete_volume" :: held 0.735s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['a637f0e9-56d2-4f92-aa4f-c9802972d1e8', '6840add5-25ef-4e1b-a650-398f0edb4fac', '18e9f2c3-ace3-43ef-8342-5056aa8e4f65', '57684039-d93a-4eb4-9181-7273c35c9a0b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:03 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:03 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:03 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.320s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:03 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Deleted volume successfully.
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3550b0f3-c94c-467e-89c4-49ee1132b6af tempest-VolumeRetypeWithoutMigrationTest-2094635946 None] Lock "cinder-043a3abe-107a-463c-b954-2beb43735746-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-574d3999-0522-4852-9dfb-f8199a614c9e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:04 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.338s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Deleted volume successfully.
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-574d3999-0522-4852-9dfb-f8199a614c9e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9ccc9265-0421-43b7-8754-50bcb631aab6 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-20ec1bec-43a7-4572-836d-e7284d47a211-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "cinder-quobyte-574d3999-0522-4852-9dfb-f8199a614c9e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-574d3999-0522-4852-9dfb-f8199a614c9e" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bee841-3eb2-4b3c-9caf-ccd2ccb7f9f6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:04 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e
Sep 30 18:02:04 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:04 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e" returned: 0 in 0.405s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:04 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e
Sep 30 18:02:04 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:05 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-574d3999-0522-4852-9dfb-f8199a614c9e" returned: 0 in 0.287s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-quobyte-574d3999-0522-4852-9dfb-f8199a614c9e" released by "delete_volume" :: held 0.768s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Created reservations ['9dbe8fc8-0375-44fc-b902-9d11760c94c4', 'cd1ffbbc-22b9-47ec-9f0a-8fab5ac77ff6', '31642037-d362-452a-87f0-adb8c9bb89fd', 'da64e4fb-bc19-4247-bfd2-1c981ac8a23a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:05 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:05 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:05 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.329s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Deleted volume successfully.
Sep 30 18:02:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-539b58be-d0df-4510-8988-60b9923fbde4 tempest-VolumesSnapshotTestJSON-997606718 None] Lock "cinder-574d3999-0522-4852-9dfb-f8199a614c9e-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ba4bd6e6-61a5-4044-9ff9-6d62fad8c704 req-5370ccda-d5e1-49a9-8813-44b74adb449a tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ba4bd6e6-61a5-4044-9ff9-6d62fad8c704 req-5370ccda-d5e1-49a9-8813-44b74adb449a tempest-TestStampPattern-1947875384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ba4bd6e6-61a5-4044-9ff9-6d62fad8c704 req-5370ccda-d5e1-49a9-8813-44b74adb449a tempest-TestStampPattern-1947875384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-ba4bd6e6-61a5-4044-9ff9-6d62fad8c704 req-5370ccda-d5e1-49a9-8813-44b74adb449a tempest-TestStampPattern-1947875384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dce87ca6-be2d-4a16-b4c0-56a9e56ecdf6', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:02:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-ba4bd6e6-61a5-4044-9ff9-6d62fad8c704 req-5370ccda-d5e1-49a9-8813-44b74adb449a tempest-TestStampPattern-1947875384 None] attachment_update completed successfully.
Sep 30 18:02:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-1e1e441a-0e5e-470d-9c4e-eea54cc58f99 req-7efe15ca-596f-4de7-97cf-10ea1dca5fb2 tempest-TestStampPattern-1947875384 None] Terminate volume connection completed successfully.
Sep 30 18:02:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1e1e441a-0e5e-470d-9c4e-eea54cc58f99 req-7efe15ca-596f-4de7-97cf-10ea1dca5fb2 tempest-TestStampPattern-1947875384 None] Deleting attachment dce87ca6-be2d-4a16-b4c0-56a9e56ecdf6. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Creating offline snapshot 5f7c759c-6a50-46ab-ae0f-deed29851a42 of volume 5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc2439-33af-4845-9c60-4a00344c95ef]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:14 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e
Sep 30 18:02:14 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:14 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" returned: 0 in 0.473s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:14 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 1G
Sep 30 18:02:14 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Flow 'volume_create_manager' (03b11adc-ad27-4f28-9ca1-f0b34d855359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5519b6a3-f300-49e1-8b93-0a252faadcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5519b6a3-f300-49e1-8b93-0a252faadcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2093030638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80289d0a-1387-4e36-a9c2-c32b5ccbee1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f17647ff04ae0b84540a1eaa384dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:15Z,use_quota=True,user_id='7d3ef94012394e7eb646cc0ef5e63a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8346c5a-f854-4c99-a99e-b1f30301b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8346c5a-f854-4c99-a99e-b1f30301b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e6b325-e6b4-409c-a7d3-de6a02591c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e6b325-e6b4-409c-a7d3-de6a02591c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80289d0a-1387-4e36-a9c2-c32b5ccbee1d', 'volume_name': 'volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c6cab8-a838-4ad0-a4e6-e253f042a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c6cab8-a838-4ad0-a4e6-e253f042a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3450eff-276c-4a7c-834a-64f51262d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:15 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Volume 80289d0a-1387-4e36-a9c2-c32b5ccbee1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d', 'volume_size': 1}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:15 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 1G" returned: 0 in 0.540s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:15 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42
Sep 30 18:02:15 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:15 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42" returned: 0 in 0.398s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:15 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 is being set with open permissions: ugo+rw
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:15 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42
Sep 30 18:02:15 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:15 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42" returned: 0 in 0.258s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:15 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info
Sep 30 18:02:15 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:16 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info" returned: 0 in 0.317s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:16 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info is being set with open permissions: ugo+rw
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:16 devstack sudo[100778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info
Sep 30 18:02:16 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:16 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.info" returned: 0 in 0.271s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2093030638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80289d0a-1387-4e36-a9c2-c32b5ccbee1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f17647ff04ae0b84540a1eaa384dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:15Z,use_quota=True,user_id='7d3ef94012394e7eb646cc0ef5e63a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Creating volume 80289d0a-1387-4e36-a9c2-c32b5ccbee1d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:02:16 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:02:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:16 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d 1073741824
Sep 30 18:02:16 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:16 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5a003227-c535-45f7-bfa8-0a9e66f293a7 tempest-TestStampPattern-1947875384 None] Create snapshot completed successfully
Sep 30 18:02:17 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d 1073741824" returned: 0 in 0.581s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:17 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d
Sep 30 18:02:17 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:17 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3450eff-276c-4a7c-834a-64f51262d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ab3e2b-316c-499e-8f72-d8808663ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:17 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Volume volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d (80289d0a-1387-4e36-a9c2-c32b5ccbee1d): created successfully
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ab3e2b-316c-499e-8f72-d8808663ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Flow 'volume_create_manager' (03b11adc-ad27-4f28-9ca1-f0b34d855359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-73afda57-bf52-4f3c-b26e-3504f5c27155 tempest-VolumesListAdminTestJSON-880967387 None] Created volume successfully.
Sep 30 18:02:18 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:02:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Flow 'volume_create_manager' (a2eb6a5c-2df8-4cbc-af92-52c9da9d9a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbbb8e2-f913-4a6c-b74d-8556041a95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbbb8e2-f913-4a6c-b74d-8556041a95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-207743810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d0415f-6c92-4267-9dd5-5fcdc92a1198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f17647ff04ae0b84540a1eaa384dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:19Z,use_quota=True,user_id='7d3ef94012394e7eb646cc0ef5e63a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d9189c-a68b-44ca-9a57-752572a213f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d9189c-a68b-44ca-9a57-752572a213f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f796886c-943d-4fa3-a7dd-a4a0247dc286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f796886c-943d-4fa3-a7dd-a4a0247dc286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d0415f-6c92-4267-9dd5-5fcdc92a1198', 'volume_name': 'volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4db905-f8a3-4f35-922c-74f9be1b5712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4db905-f8a3-4f35-922c-74f9be1b5712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df9af6-d633-409b-aef5-04d9000d177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:19 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Volume f8d0415f-6c92-4267-9dd5-5fcdc92a1198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198', 'volume_size': 1}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-207743810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d0415f-6c92-4267-9dd5-5fcdc92a1198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f17647ff04ae0b84540a1eaa384dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:19Z,use_quota=True,user_id='7d3ef94012394e7eb646cc0ef5e63a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Creating volume f8d0415f-6c92-4267-9dd5-5fcdc92a1198 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:02:19 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:19 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 1073741824
Sep 30 18:02:19 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:19 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 1073741824" returned: 0 in 0.625s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:19 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198
Sep 30 18:02:19 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:20 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198" returned: 0 in 0.400s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df9af6-d633-409b-aef5-04d9000d177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49355517-aa10-4f4d-b714-2b64f89ac965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Volume volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 (f8d0415f-6c92-4267-9dd5-5fcdc92a1198): created successfully
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49355517-aa10-4f4d-b714-2b64f89ac965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Flow 'volume_create_manager' (a2eb6a5c-2df8-4cbc-af92-52c9da9d9a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1357c43a-d44b-4e4d-be8d-a1ddbfc2c160 tempest-VolumesListAdminTestJSON-880967387 None] Created volume successfully.
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Flow 'volume_create_manager' (c8db20c4-3a40-492b-9ce5-558bfea214ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be599dfa-fba1-430b-845e-05a3c16a67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be599dfa-fba1-430b-845e-05a3c16a67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-835016202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7b75eb-3805-4ffc-9561-47e5a4d8c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f17647ff04ae0b84540a1eaa384dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:22Z,use_quota=True,user_id='7d3ef94012394e7eb646cc0ef5e63a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad4d7ba-fe05-4ce4-85c7-4f4b66bc4263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad4d7ba-fe05-4ce4-85c7-4f4b66bc4263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0dfdbb-28c5-4b82-8e2f-eb186c6f5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0dfdbb-28c5-4b82-8e2f-eb186c6f5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7b75eb-3805-4ffc-9561-47e5a4d8c715', 'volume_name': 'volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9df69b-f9f0-425a-a48d-64a019c1e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9df69b-f9f0-425a-a48d-64a019c1e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5254c582-9621-453d-962d-b8db8b5e56bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Volume 2d7b75eb-3805-4ffc-9561-47e5a4d8c715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715', 'volume_size': 1}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-835016202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7b75eb-3805-4ffc-9561-47e5a4d8c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f17647ff04ae0b84540a1eaa384dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:22Z,use_quota=True,user_id='7d3ef94012394e7eb646cc0ef5e63a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Creating volume 2d7b75eb-3805-4ffc-9561-47e5a4d8c715 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:02:21 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:02:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:21 devstack sudo[100832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 1073741824
Sep 30 18:02:21 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:22 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 1073741824" returned: 0 in 0.639s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:22 devstack sudo[100838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715
Sep 30 18:02:22 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:22 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715" returned: 0 in 0.525s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:02:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5254c582-9621-453d-962d-b8db8b5e56bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e628b4-214f-4f2d-8c3b-4b5712a4ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Volume volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 (2d7b75eb-3805-4ffc-9561-47e5a4d8c715): created successfully
Sep 30 18:02:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e628b4-214f-4f2d-8c3b-4b5712a4ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Flow 'volume_create_manager' (c8db20c4-3a40-492b-9ce5-558bfea214ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-09dd7a0e-c3d0-452d-95eb-adde6d42277b tempest-VolumesListAdminTestJSON-880967387 None] Created volume successfully.
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Flow 'volume_create_manager' (9403e171-7def-40ac-991c-0159ca68a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6ec35d-c4c4-4fa5-878a-7ad86338648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6ec35d-c4c4-4fa5-878a-7ad86338648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded72ade-e11c-4e6a-a134-05ecc23ad5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a61ee5507f4543a21bc8d91385e4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:25Z,use_quota=True,user_id='1bec2b812a194c189520aec4c6749dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed64133-930a-4cb1-a8b0-3273456b4e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed64133-930a-4cb1-a8b0-3273456b4e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13020774-eca4-4cfc-a6b4-2df56a3682a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13020774-eca4-4cfc-a6b4-2df56a3682a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded72ade-e11c-4e6a-a134-05ecc23ad5cf', 'volume_name': 'volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe9d7fa-a709-4998-9bce-ca2b24188c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe9d7fa-a709-4998-9bce-ca2b24188c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5246c713-dd65-4ca9-af76-f35b68164bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:25 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Volume ded72ade-e11c-4e6a-a134-05ecc23ad5cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf', 'volume_size': 1}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded72ade-e11c-4e6a-a134-05ecc23ad5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a61ee5507f4543a21bc8d91385e4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:25Z,use_quota=True,user_id='1bec2b812a194c189520aec4c6749dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Creating volume ded72ade-e11c-4e6a-a134-05ecc23ad5cf {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:02:25 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:25 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf 1073741824
Sep 30 18:02:25 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:25 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf 1073741824" returned: 0 in 0.516s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:25 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf
Sep 30 18:02:25 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:26 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf" returned: 0 in 0.319s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5246c713-dd65-4ca9-af76-f35b68164bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df358af2-936c-4bdd-82e2-de4a46302b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Volume volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf (ded72ade-e11c-4e6a-a134-05ecc23ad5cf): created successfully
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df358af2-936c-4bdd-82e2-de4a46302b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Flow 'volume_create_manager' (9403e171-7def-40ac-991c-0159ca68a330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-03550fad-b172-4822-b24e-998aa6a6aa9e tempest-VolumesListAdminTestJSON-1668406460 None] Created volume successfully.
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Flow 'volume_create_manager' (99474792-fff4-4d59-b1fb-df4ebc3afcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb5a719-3f2a-4cd5-bec8-4d798a6c30c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb5a719-3f2a-4cd5-bec8-4d798a6c30c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1385881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc7a21b-0e71-416b-ba07-699779afcbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef1073ed35c4743af1efb0e410f127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f7c759c-6a50-46ab-ae0f-deed29851a42,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:27Z,use_quota=True,user_id='2c4074c753394aa68d97097baee33621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb06878-4821-436b-9965-9b4b9e12b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb06878-4821-436b-9965-9b4b9e12b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f79a078-908e-4229-a3d4-778caebb8132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f79a078-908e-4229-a3d4-778caebb8132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2bc7a21b-0e71-416b-ba07-699779afcbd9', 'volume_name': 'volume-2bc7a21b-0e71-416b-ba07-699779afcbd9', 'volume_size': 1, 'snapshot_id': '5f7c759c-6a50-46ab-ae0f-deed29851a42'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62dc23d-7f00-4659-9819-42a793bb7d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62dc23d-7f00-4659-9819-42a793bb7d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e273e7e2-d36b-45a2-9dd0-1a71652e2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Volume 2bc7a21b-0e71-416b-ba07-699779afcbd9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2bc7a21b-0e71-416b-ba07-699779afcbd9', 'volume_size': 1, 'snapshot_id': '5f7c759c-6a50-46ab-ae0f-deed29851a42'}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-quobyte-5f7c759c-6a50-46ab-ae0f-deed29851a42-2bc7a21b-0e71-416b-ba07-699779afcbd9" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f7c759c-6a50-46ab-ae0f-deed29851a42-2bc7a21b-0e71-416b-ba07-699779afcbd9" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Creating volume 2bc7a21b-0e71-416b-ba07-699779afcbd9 from snapshot 5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-quobyte-2bc7a21b-0e71-416b-ba07-699779afcbd9" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-2bc7a21b-0e71-416b-ba07-699779afcbd9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] snapshot: 5f7c759c-6a50-46ab-ae0f-deed29851a42, volume: 2bc7a21b-0e71-416b-ba07-699779afcbd9,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c317be-3f89-47db-9ff6-fc9c3ebb7108]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:27 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42
Sep 30 18:02:27 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Acquiring lock "cinder-ded72ade-e11c-4e6a-a134-05ecc23ad5cf-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Lock "cinder-ded72ade-e11c-4e6a-a134-05ecc23ad5cf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Acquiring lock "cinder-quobyte-ded72ade-e11c-4e6a-a134-05ecc23ad5cf" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Lock "cinder-quobyte-ded72ade-e11c-4e6a-a134-05ecc23ad5cf" acquired by "delete_volume" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96e798-76b2-4d13-9979-f072cf9fd27f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "cinder-2d7b75eb-3805-4ffc-9561-47e5a4d8c715-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:27 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42" returned: 0 in 0.640s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-2d7b75eb-3805-4ffc-9561-47e5a4d8c715-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3b0a9-eb83-433c-842a-9913dca4d55a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:27 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf
Sep 30 18:02:27 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "cinder-quobyte-2d7b75eb-3805-4ffc-9561-47e5a4d8c715" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-quobyte-2d7b75eb-3805-4ffc-9561-47e5a4d8c715" acquired by "delete_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a96403f-5769-4f87-8d2a-a20ddc53952c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:28 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e
Sep 30 18:02:28 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:28 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715
Sep 30 18:02:28 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:28 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf" returned: 0 in 0.677s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:28 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" returned: 0 in 0.650s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:02:28 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf
Sep 30 18:02:28 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:28 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9
Sep 30 18:02:28 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:28 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715" returned: 0 in 0.605s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:28 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715
Sep 30 18:02:28 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:28 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ded72ade-e11c-4e6a-a134-05ecc23ad5cf" returned: 0 in 0.434s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Lock "cinder-quobyte-ded72ade-e11c-4e6a-a134-05ecc23ad5cf" released by "delete_volume" :: held 1.198s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Created reservations ['35b11c99-cb57-42c6-8a35-e23d3afae50b', '6554d21f-6ced-40a5-b1a2-df155bf1559e', '2b7d881c-05ca-47e9-8511-1df2c2638702', '99058609-23e4-4599-bb43-d2ecb0fef2ba'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:29 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2d7b75eb-3805-4ffc-9561-47e5a4d8c715" returned: 0 in 0.445s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-quobyte-2d7b75eb-3805-4ffc-9561-47e5a4d8c715" released by "delete_volume" :: held 1.116s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:29 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Created reservations ['e9a0c734-ea08-4ec4-b238-f1c33f0c9d3b', '92c23fd2-186c-4e0b-9fb1-6a6796b284bd', '3e3459dd-9e70-4940-8dec-b23d9b096dcb', 'a5cd82ed-b1c7-4b97-958b-315a3b657192'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:29 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:29 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:29 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:29 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.437s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Deleted volume successfully.
Sep 30 18:02:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-259790bd-f273-4835-b5b7-9bb2a4b83910 tempest-VolumesListAdminTestJSON-1668406460 None] Lock "cinder-ded72ade-e11c-4e6a-a134-05ecc23ad5cf-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:30 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.548s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Deleted volume successfully.
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4d188c3-fd01-4bbe-a1f3-9a80d725980c tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-2d7b75eb-3805-4ffc-9561-47e5a4d8c715-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "cinder-f8d0415f-6c92-4267-9dd5-5fcdc92a1198-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-f8d0415f-6c92-4267-9dd5-5fcdc92a1198-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "cinder-quobyte-f8d0415f-6c92-4267-9dd5-5fcdc92a1198" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-quobyte-f8d0415f-6c92-4267-9dd5-5fcdc92a1198" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f245b-b063-4408-9376-bd24d5e5d357]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:30 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198
Sep 30 18:02:30 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:31 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198" returned: 0 in 0.836s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:31 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198
Sep 30 18:02:31 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:31 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f8d0415f-6c92-4267-9dd5-5fcdc92a1198" returned: 0 in 0.536s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-quobyte-f8d0415f-6c92-4267-9dd5-5fcdc92a1198" released by "delete_volume" :: held 1.500s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Created reservations ['d8e135e4-037e-4b0f-83b2-4a60034f53cd', 'f99c46f1-435b-4263-860b-78da1f2edc57', 'e578885b-c061-4022-8fed-d9a3c8544cca', 'f51f824f-395a-4ed3-ba1f-d457709a16c5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:32 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:32 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:33 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.642s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Deleted volume successfully.
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "cinder-80289d0a-1387-4e36-a9c2-c32b5ccbee1d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-41466f9a-c4db-4c79-a234-653a43e53322 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-f8d0415f-6c92-4267-9dd5-5fcdc92a1198-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-80289d0a-1387-4e36-a9c2-c32b5ccbee1d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "cinder-quobyte-80289d0a-1387-4e36-a9c2-c32b5ccbee1d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-quobyte-80289d0a-1387-4e36-a9c2-c32b5ccbee1d" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522e1ef-8485-44bf-8b7d-52cddb284a2e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:33 devstack sudo[100910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d
Sep 30 18:02:33 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:34 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d" returned: 0 in 0.979s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:34 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d
Sep 30 18:02:34 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:35 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-80289d0a-1387-4e36-a9c2-c32b5ccbee1d" returned: 0 in 0.641s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-quobyte-80289d0a-1387-4e36-a9c2-c32b5ccbee1d" released by "delete_volume" :: held 1.741s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Created reservations ['6f4f7d70-e49d-4b72-8b77-1656e7fc04df', '8af7d4f4-1227-459f-ad57-13d24bbc301f', 'ad9b4816-22b7-4608-ad2d-517b26759b1c', 'cf062969-e4a1-4971-829d-8a4d66254e21'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:35 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:35 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:35 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.618s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:35 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Deleted volume successfully.
Sep 30 18:02:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-50c3e1a6-76cd-41d0-838c-d4cf481a7914 tempest-VolumesListAdminTestJSON-880967387 None] Lock "cinder-80289d0a-1387-4e36-a9c2-c32b5ccbee1d-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:38 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9" returned: 0 in 9.996s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:02:38 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Converted 1024.00 MB image at 102.41 MB/s
Sep 30 18:02:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 is being set with open permissions: ugo+rw
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:38 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9
Sep 30 18:02:38 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:38 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-2bc7a21b-0e71-416b-ba07-699779afcbd9" released by "_copy_volume_from_snapshot" :: held 11.820s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f7c759c-6a50-46ab-ae0f-deed29851a42-2bc7a21b-0e71-416b-ba07-699779afcbd9" released by "_create_volume_from_snapshot" :: held 11.943s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:02:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.963s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e273e7e2-d36b-45a2-9dd0-1a71652e2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc7a21b-0e71-416b-ba07-699779afcbd9', 'volume_size': 1, 'snapshot_id': '5f7c759c-6a50-46ab-ae0f-deed29851a42'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca9ae8-d27a-42d5-b66e-2c95861afa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:39 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Volume volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 (2bc7a21b-0e71-416b-ba07-699779afcbd9): created successfully
Sep 30 18:02:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca9ae8-d27a-42d5-b66e-2c95861afa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Flow 'volume_create_manager' (99474792-fff4-4d59-b1fb-df4ebc3afcff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-103bb8fa-1b4a-4720-a02a-dec6f561137d tempest-TestStampPattern-1947875384 None] Created volume successfully.
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:46 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:02:46 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:47 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.830s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Flow 'volume_create_manager' (6c4c211e-0831-4d52-a922-f169514ce550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4975c02e-2246-46e9-8c5f-0571fcfcd384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4975c02e-2246-46e9-8c5f-0571fcfcd384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1555646344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e57605-09e4-454c-a990-5fb573ab9102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739fb01a3ecd4e1485f34f874bd75f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:48Z,use_quota=True,user_id='8038a683946741b3b3c60cb2512097a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946b5803-3808-4a78-adb8-16d72c58fd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946b5803-3808-4a78-adb8-16d72c58fd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e601bc-9e94-4e27-8d93-d118a321da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:47 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:02:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e601bc-9e94-4e27-8d93-d118a321da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77e57605-09e4-454c-a990-5fb573ab9102', 'volume_name': 'volume-77e57605-09e4-454c-a990-5fb573ab9102', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c149775010>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f73915f-3ae0-4ea3-87e4-fc8977d21576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f73915f-3ae0-4ea3-87e4-fc8977d21576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be88094e-ef9d-40b0-8640-0bb3470c424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Volume 77e57605-09e4-454c-a990-5fb573ab9102: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77e57605-09e4-454c-a990-5fb573ab9102', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c149775010>}
Sep 30 18:02:48 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Trying to clone 77e57605-09e4-454c-a990-5fb573ab9102 from image 90139efc-54c0-4670-ab72-2da0af285eb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:02:49 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:02:49 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 18:02:49 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8584219e-a2e5-449f-ae00-ac459a98af33]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:49 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD
Sep 30 18:02:49 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:50 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 is fetched for user 8038a683946741b3b3c60cb2512097a8. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd9c1c-f20b-47e7-9cb2-eadbbc06df35]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:50 devstack sudo[101093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD
Sep 30 18:02:50 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:50 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1555646344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e57605-09e4-454c-a990-5fb573ab9102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739fb01a3ecd4e1485f34f874bd75f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:02:48Z,use_quota=True,user_id='8038a683946741b3b3c60cb2512097a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Creating volume 77e57605-09e4-454c-a990-5fb573ab9102 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:02:50 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:02:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:50 devstack sudo[101098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 1073741824
Sep 30 18:02:50 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:51 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 1073741824" returned: 0 in 0.605s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:51 devstack sudo[101104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102
Sep 30 18:02:51 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:51 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102" returned: 0 in 0.372s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Attempting download of 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume 77e57605-09e4-454c-a990-5fb573ab9102. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e909fa-02eb-470b-9519-a0292e8e6301]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_ {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:52 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_
Sep 30 18:02:52 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:52 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_" returned: 0 in 0.541s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_ {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:52 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_
Sep 30 18:02:52 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:52 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_" returned: 1 in 0.428s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_y9xsob1_' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:02:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295c562-cf03-4d0a-aee3-f5c933bcdb16]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:02:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:53 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD
Sep 30 18:02:53 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:53 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:53 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] 90139efc-54c0-4670-ab72-2da0af285eb6 was qcow2, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:02:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:53 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102
Sep 30 18:02:53 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:57 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102" returned: 0 in 3.785s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:57 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_047d8k3fdevstack@QuobyteHD, size 112.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:02:57 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Converted 112.00 MB image at 29.54 MB/s
Sep 30 18:02:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:02:57 devstack sudo[101213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 1G
Sep 30 18:02:57 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:02:58 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 1G" returned: 0 in 0.673s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Downloaded image 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume 77e57605-09e4-454c-a990-5fb573ab9102 successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 for user 8038a683946741b3b3c60cb2512097a8 is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Marking volume 77e57605-09e4-454c-a990-5fb573ab9102 as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Copying metadata from image 90139efc-54c0-4670-ab72-2da0af285eb6 to 77e57605-09e4-454c-a990-5fb573ab9102. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Creating volume glance metadata for volume 77e57605-09e4-454c-a990-5fb573ab9102 backed by image 90139efc-54c0-4670-ab72-2da0af285eb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=105,cinder:INSERT=26,cinder:SELECT=89,cinder:DELETE=9 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be88094e-ef9d-40b0-8640-0bb3470c424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e57605-09e4-454c-a990-5fb573ab9102', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c149775010>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdc0796-5a58-4451-92fe-3b8e2350416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=88,cinder:UPDATE=99,cinder:DELETE=7,cinder:INSERT=32 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:02:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Volume volume-77e57605-09e4-454c-a990-5fb573ab9102 (77e57605-09e4-454c-a990-5fb573ab9102): created successfully
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdc0796-5a58-4451-92fe-3b8e2350416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:02:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Flow 'volume_create_manager' (6c4c211e-0831-4d52-a922-f169514ce550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:02:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-63e9007d-259e-4837-b37f-23180795ebc0 tempest-VolumesImageMetadata-370883072 None] Created volume successfully.
Sep 30 18:03:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Acquiring lock "cinder-77e57605-09e4-454c-a990-5fb573ab9102-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Lock "cinder-77e57605-09e4-454c-a990-5fb573ab9102-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Acquiring lock "cinder-quobyte-77e57605-09e4-454c-a990-5fb573ab9102" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Lock "cinder-quobyte-77e57605-09e4-454c-a990-5fb573ab9102" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:00 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c42a7f-0146-49c1-a755-527ec5f0b64a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:00 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102
Sep 30 18:03:00 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:01 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102" returned: 0 in 0.781s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:01 devstack sudo[101225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102
Sep 30 18:03:01 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:01 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-77e57605-09e4-454c-a990-5fb573ab9102" returned: 0 in 0.737s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (1dd6901d-d192-48b5-b1b4-7c4da0e81517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f020b90-22d7-4d7b-93ac-0bdf23c025fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Lock "cinder-quobyte-77e57605-09e4-454c-a990-5fb573ab9102" released by "delete_volume" :: held 1.686s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f020b90-22d7-4d7b-93ac-0bdf23c025fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1958304639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf80d22e-9313-4837-bf09-1432787af94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:02Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f47d60-79f3-4243-853b-0d50adbadd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f47d60-79f3-4243-853b-0d50adbadd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33761763-0153-4b73-b04e-36757908b3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33761763-0153-4b73-b04e-36757908b3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf80d22e-9313-4837-bf09-1432787af94f', 'volume_name': 'volume-cf80d22e-9313-4837-bf09-1432787af94f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773b3be9-f7d2-42d5-93ea-c505b5d16b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773b3be9-f7d2-42d5-93ea-c505b5d16b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdef5847-247a-405c-bed7-732985e65fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:02 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Volume cf80d22e-9313-4837-bf09-1432787af94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf80d22e-9313-4837-bf09-1432787af94f', 'volume_size': 1}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1958304639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf80d22e-9313-4837-bf09-1432787af94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:02Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Creating volume cf80d22e-9313-4837-bf09-1432787af94f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:02 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:02 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f 1073741824
Sep 30 18:03:02 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Created reservations ['0083b775-03d3-4b6c-bb32-a14830156b80', 'ffd51721-1c73-45ae-892f-bc1a4876ec8e', '2b5fd201-9b68-4823-9367-11924cf60a30', '3bb8047d-28ea-4630-974c-cb1d8d5f679a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:02 devstack sudo[101233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:02 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:03 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.671s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Deleted volume successfully.
Sep 30 18:03:03 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f 1073741824" returned: 0 in 1.074s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-beda85ff-4ded-41c8-95cc-5eaa01860e65 tempest-VolumesImageMetadata-370883072 None] Lock "cinder-77e57605-09e4-454c-a990-5fb573ab9102-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:03 devstack sudo[101240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f
Sep 30 18:03:03 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:03 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f" returned: 0 in 0.496s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdef5847-247a-405c-bed7-732985e65fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf80d22e-9313-4837-bf09-1432787af94f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fb4d35-bfc7-45e9-ace3-97eb8935a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:03 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Volume volume-cf80d22e-9313-4837-bf09-1432787af94f (cf80d22e-9313-4837-bf09-1432787af94f): created successfully
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fb4d35-bfc7-45e9-ace3-97eb8935a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (1dd6901d-d192-48b5-b1b4-7c4da0e81517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-23334b47-98f8-4f45-a583-f58f668b6973 tempest-VolumesActionsTest-1002174928 None] Created volume successfully.
Sep 30 18:03:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2b61da2a-866f-4a09-85cd-416446496045 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f" by "attach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2b61da2a-866f-4a09-85cd-416446496045 tempest-VolumesActionsTest-1002174928 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f" acquired by "attach_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2b61da2a-866f-4a09-85cd-416446496045 tempest-VolumesActionsTest-1002174928 None] Attaching volume cf80d22e-9313-4837-bf09-1432787af94f to instance 8ebc5c7e-6fd0-4aad-a275-bc355376bd87 at mountpoint /dev/vdb on host None.
Sep 30 18:03:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2b61da2a-866f-4a09-85cd-416446496045 tempest-VolumesActionsTest-1002174928 None] Attach volume completed successfully.
Sep 30 18:03:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2b61da2a-866f-4a09-85cd-416446496045 tempest-VolumesActionsTest-1002174928 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f" released by "attach_volume" :: held 0.143s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dd227e61-b6bb-4503-8340-07ab733b6344 tempest-VolumesActionsTest-2061584223 None] Terminate volume connection completed successfully.
Sep 30 18:03:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dd227e61-b6bb-4503-8340-07ab733b6344 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-detach_volume" by "detach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dd227e61-b6bb-4503-8340-07ab733b6344 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dd227e61-b6bb-4503-8340-07ab733b6344 tempest-VolumesActionsTest-2061584223 None] Detaching volume cf80d22e-9313-4837-bf09-1432787af94f from instance 8ebc5c7e-6fd0-4aad-a275-bc355376bd87.
Sep 30 18:03:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dd227e61-b6bb-4503-8340-07ab733b6344 tempest-VolumesActionsTest-2061584223 None] Detach volume completed successfully.
Sep 30 18:03:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dd227e61-b6bb-4503-8340-07ab733b6344 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fdc8d611-a1fa-40ed-951b-9393749326f5 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-detach_volume" by "detach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fdc8d611-a1fa-40ed-951b-9393749326f5 tempest-VolumesActionsTest-1002174928 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fdc8d611-a1fa-40ed-951b-9393749326f5 tempest-VolumesActionsTest-1002174928 None] Volume detach called, but volume not attached.
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fdc8d611-a1fa-40ed-951b-9393749326f5 tempest-VolumesActionsTest-1002174928 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Acquiring lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Acquiring lock "cinder-quobyte-cf80d22e-9313-4837-bf09-1432787af94f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Lock "cinder-quobyte-cf80d22e-9313-4837-bf09-1432787af94f" acquired by "delete_volume" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f09bd0-9a1e-4ec6-8131-eab57bbd17d2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:06 devstack sudo[101255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f
Sep 30 18:03:06 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:07 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f" returned: 0 in 0.770s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:07 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f
Sep 30 18:03:07 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:07 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cf80d22e-9313-4837-bf09-1432787af94f" returned: 0 in 0.348s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Lock "cinder-quobyte-cf80d22e-9313-4837-bf09-1432787af94f" released by "delete_volume" :: held 1.205s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Created reservations ['529ea44c-ed00-48b8-832f-f0a8322b83a2', '9f0b84cf-9483-4c37-8967-eb9916b5742f', '36014007-c5a7-45d6-b158-e57c352ee17a', 'a6bb48a6-c0cf-410b-826f-08476bcdecbf'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:08 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:08 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:08 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.386s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Deleted volume successfully.
Sep 30 18:03:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-df6d3cd8-de60-49f1-9817-36a786074bcc tempest-VolumesActionsTest-1002174928 None] Lock "cinder-cf80d22e-9313-4837-bf09-1432787af94f-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Flow 'volume_create_manager' (6979b306-93b5-4c2e-83ba-9b4226ac74a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f815e3d8-6c05-4759-8274-b0937c52eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f815e3d8-6c05-4759-8274-b0937c52eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-102431077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ccaa52-e4cf-4d74-8624-504471778b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d781227cc4794e0b8d40ee5a7192664d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:09Z,use_quota=True,user_id='2e47b20f3fd54c97945acafc5baeb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1999c72d-efc6-446e-86a7-945895c2a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1999c72d-efc6-446e-86a7-945895c2a961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b327e13-9d33-4ef3-9610-81af8e8f6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b327e13-9d33-4ef3-9610-81af8e8f6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ccaa52-e4cf-4d74-8624-504471778b38', 'volume_name': 'volume-e4ccaa52-e4cf-4d74-8624-504471778b38', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c645ce-5a01-4cd5-9253-81674d909f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c645ce-5a01-4cd5-9253-81674d909f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a6f1da-ec59-4964-b873-7b858345ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:09 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Volume e4ccaa52-e4cf-4d74-8624-504471778b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ccaa52-e4cf-4d74-8624-504471778b38', 'volume_size': 1}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-102431077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ccaa52-e4cf-4d74-8624-504471778b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d781227cc4794e0b8d40ee5a7192664d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:09Z,use_quota=True,user_id='2e47b20f3fd54c97945acafc5baeb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Creating volume e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:09 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:09 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 1073741824
Sep 30 18:03:09 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:10 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 1073741824" returned: 0 in 0.663s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:10 devstack sudo[101315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38
Sep 30 18:03:10 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:10 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a6f1da-ec59-4964-b873-7b858345ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ccaa52-e4cf-4d74-8624-504471778b38', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1629e73a-d3fa-422a-8504-ca2bbf78e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:10 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Volume volume-e4ccaa52-e4cf-4d74-8624-504471778b38 (e4ccaa52-e4cf-4d74-8624-504471778b38): created successfully
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1629e73a-d3fa-422a-8504-ca2bbf78e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Flow 'volume_create_manager' (6979b306-93b5-4c2e-83ba-9b4226ac74a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-66234fe1-2388-4b9b-b7b0-ec19b017f5e7 tempest-VolumesDeleteCascade-568309283 None] Created volume successfully.
Sep 30 18:03:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Creating offline snapshot 56b594c4-56b6-489f-886c-c59095409440 of volume e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:03:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5dc4df-61a5-42e5-b189-b7b07c2dfd9a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:12 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38
Sep 30 18:03:12 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:12 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38" returned: 0 in 0.568s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:12 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 1G
Sep 30 18:03:12 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (216e8c0b-c12e-40f7-b748-d27cfdecbf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61870e67-739b-4f3b-9811-3f1fcf1a41aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61870e67-739b-4f3b-9811-3f1fcf1a41aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22695440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6cbc25-7308-4e38-9e01-8a11573b26ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:13Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe915ec-1aab-4c04-8dcf-a473b53e8072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe915ec-1aab-4c04-8dcf-a473b53e8072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9a1498-1f7a-4666-9183-3764a902ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9a1498-1f7a-4666-9183-3764a902ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6cbc25-7308-4e38-9e01-8a11573b26ca', 'volume_name': 'volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335a4465-a968-4d71-acf6-28c1c64c0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335a4465-a968-4d71-acf6-28c1c64c0f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea923e8c-e437-4443-9c60-2b23c446e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:12 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Volume 4f6cbc25-7308-4e38-9e01-8a11573b26ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca', 'volume_size': 1}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:12 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 1G" returned: 0 in 0.450s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ccaa52-e4cf-4d74-8624-504471778b38 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:12 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ccaa52-e4cf-4d74-8624-504471778b38 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:12 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:13 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ccaa52-e4cf-4d74-8624-504471778b38 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.339s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:13 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 is being set with open permissions: ugo+rw
Sep 30 18:03:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:13 devstack sudo[101417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:13 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:13 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:13 devstack sudo[101420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info
Sep 30 18:03:13 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:13 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info" returned: 0 in 0.323s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:13 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info is being set with open permissions: ugo+rw
Sep 30 18:03:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:13 devstack sudo[101425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info
Sep 30 18:03:13 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:14 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.info" returned: 0 in 0.270s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22695440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6cbc25-7308-4e38-9e01-8a11573b26ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:13Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Creating volume 4f6cbc25-7308-4e38-9e01-8a11573b26ca {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:14 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:14 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca 1073741824
Sep 30 18:03:14 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:14 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a2746496-520b-4a4c-8f2d-d12455c85f57 tempest-VolumesDeleteCascade-568309283 None] Create snapshot completed successfully
Sep 30 18:03:14 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca 1073741824" returned: 0 in 0.522s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:14 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca
Sep 30 18:03:14 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:15 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca" returned: 0 in 0.325s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea923e8c-e437-4443-9c60-2b23c446e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa657ac0-39fa-4a1e-8023-9005dc45b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:15 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Volume volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca (4f6cbc25-7308-4e38-9e01-8a11573b26ca): created successfully
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa657ac0-39fa-4a1e-8023-9005dc45b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (216e8c0b-c12e-40f7-b748-d27cfdecbf9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ecd5e721-17c0-4a49-a8a6-0df0fd70c715 tempest-VolumesActionsTest-1002174928 None] Created volume successfully.
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Creating offline snapshot 4b53213c-087c-4f5a-9392-b5cbcb5febde of volume e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab59056-50cb-4205-a478-f995bed0181b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:15 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:15 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-4f6cbc25-7308-4e38-9e01-8a11573b26ca-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-4f6cbc25-7308-4e38-9e01-8a11573b26ca-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-quobyte-4f6cbc25-7308-4e38-9e01-8a11573b26ca" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:16 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.815s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4ccaa52-e4cf-4d74-8624-504471778b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-4f6cbc25-7308-4e38-9e01-8a11573b26ca" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:16 devstack sudo[101444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde 1G
Sep 30 18:03:16 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def188e-fbf9-4177-a076-2544c389b1ac]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:16 devstack sudo[101446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca
Sep 30 18:03:16 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:16 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca" returned: 0 in 0.498s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:16 devstack sudo[101455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca
Sep 30 18:03:16 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:17 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde 1G" returned: 0 in 0.738s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:17 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde
Sep 30 18:03:17 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:17 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4f6cbc25-7308-4e38-9e01-8a11573b26ca" returned: 0 in 0.388s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-4f6cbc25-7308-4e38-9e01-8a11573b26ca" released by "delete_volume" :: held 1.000s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Created reservations ['3a852cf7-6692-44b7-9ceb-45ddd098527b', 'fd5a47f5-72a5-4c13-99d0-76850872816b', '3e889fc5-6bc0-4d38-91e1-07cffc4b4c6b', '434ab72f-d05b-4d30-a5da-ccb065e77c9f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:17 devstack sudo[101462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:17 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:17 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde" returned: 0 in 0.619s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:17 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde is being set with open permissions: ugo+rw
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:17 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde
Sep 30 18:03:17 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:17 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.354s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Deleted volume successfully.
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-21d9cdd9-1123-41ba-a88c-766922359936 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-4f6cbc25-7308-4e38-9e01-8a11573b26ca-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:17 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3eb9732b-1ca7-4008-96c7-4f7f81ebcd27 tempest-VolumesDeleteCascade-568309283 None] Create snapshot completed successfully
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-e4ccaa52-e4cf-4d74-8624-504471778b38-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-e4ccaa52-e4cf-4d74-8624-504471778b38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Performing cascade delete. {{(pid=87418) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-4b53213c-087c-4f5a-9392-b5cbcb5febde-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-4b53213c-087c-4f5a-9392-b5cbcb5febde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-4b53213c-087c-4f5a-9392-b5cbcb5febde" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-4b53213c-087c-4f5a-9392-b5cbcb5febde" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Deleting offline snapshot 4b53213c-087c-4f5a-9392-b5cbcb5febde of volume e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] snapshot_file for this snap is: volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5cc9c8-7459-4793-bd7d-7a8701d3b071]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:18 devstack sudo[101470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde
Sep 30 18:03:18 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (d659aa3c-faf2-4165-9c28-6c91da9e2827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae18c85-1ead-49d1-a1ba-173fc176ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae18c85-1ead-49d1-a1ba-173fc176ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1262013029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa8e63a-8aac-4051-839c-a5145480292e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:19Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f07e0-1d4c-4901-acbe-45ca4f956e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f07e0-1d4c-4901-acbe-45ca4f956e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c277156-399e-44b0-80f8-884989e7fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c277156-399e-44b0-80f8-884989e7fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa8e63a-8aac-4051-839c-a5145480292e', 'volume_name': 'volume-2aa8e63a-8aac-4051-839c-a5145480292e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4dfa7c-e8e1-4c60-aeb9-cc17d24d856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4dfa7c-e8e1-4c60-aeb9-cc17d24d856e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb5b79e-335e-41a7-a8fc-bf536544a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:19 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Volume 2aa8e63a-8aac-4051-839c-a5145480292e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa8e63a-8aac-4051-839c-a5145480292e', 'volume_size': 1}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1262013029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa8e63a-8aac-4051-839c-a5145480292e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:19Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Creating volume 2aa8e63a-8aac-4051-839c-a5145480292e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:19 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:19 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e 1073741824
Sep 30 18:03:19 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:19 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde" returned: 0 in 0.462s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4ccaa52-e4cf-4d74-8624-504471778b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22cef6-dbc3-41df-ab42-1afa84322358]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:19 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:19 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:19 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e 1073741824" returned: 0 in 0.433s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:19 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e
Sep 30 18:03:19 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:19 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.429s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4ccaa52-e4cf-4d74-8624-504471778b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:19 devstack sudo[101488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde
Sep 30 18:03:19 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:19 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb5b79e-335e-41a7-a8fc-bf536544a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa8e63a-8aac-4051-839c-a5145480292e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7409115e-bcb8-4ce1-9973-1b07a07bcf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Volume volume-2aa8e63a-8aac-4051-839c-a5145480292e (2aa8e63a-8aac-4051-839c-a5145480292e): created successfully
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7409115e-bcb8-4ce1-9973-1b07a07bcf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (d659aa3c-faf2-4165-9c28-6c91da9e2827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f4c0e1fc-f54d-4989-a412-995dc44067cc tempest-VolumesActionsTest-1002174928 None] Created volume successfully.
Sep 30 18:03:20 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde" returned: 0 in 0.410s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:20 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde
Sep 30 18:03:20 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:20 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.4b53213c-087c-4f5a-9392-b5cbcb5febde" returned: 0 in 0.242s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-4b53213c-087c-4f5a-9392-b5cbcb5febde" released by "_delete_snapshot" :: held 1.647s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" released by "delete_snapshot" :: held 1.682s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Created reservations ['a46ac150-bfcf-4f2a-8bf6-a8ca1cf88bd5', 'e45fe196-2f51-472a-b397-7f9c5add85ad', '9a1d8982-1361-4da8-926c-9ce1dfad9668', '94bfd95c-70af-424d-a76a-10db761b31ac'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Delete snapshot completed successfully.
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-4b53213c-087c-4f5a-9392-b5cbcb5febde-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-56b594c4-56b6-489f-886c-c59095409440-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-56b594c4-56b6-489f-886c-c59095409440-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-56b594c4-56b6-489f-886c-c59095409440" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-56b594c4-56b6-489f-886c-c59095409440" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Deleting offline snapshot 56b594c4-56b6-489f-886c-c59095409440 of volume e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] snapshot_file for this snap is: volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aad20a-cff1-48d2-b20a-97da9fcd3e66]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:20 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:20 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:21 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.388s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4ccaa52-e4cf-4d74-8624-504471778b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4d0b80-5f38-4587-b14d-10f7aedde3c2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:21 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38
Sep 30 18:03:21 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-2aa8e63a-8aac-4051-839c-a5145480292e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-2aa8e63a-8aac-4051-839c-a5145480292e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-quobyte-2aa8e63a-8aac-4051-839c-a5145480292e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-2aa8e63a-8aac-4051-839c-a5145480292e" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f093e2-7d8b-4ef6-833d-ebf307c07ca9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:21 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38" returned: 0 in 0.417s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:21 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:21 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:21 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e
Sep 30 18:03:21 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:21 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.368s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:21 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e" returned: 0 in 0.407s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:21 devstack sudo[101522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440
Sep 30 18:03:21 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:21 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e
Sep 30 18:03:21 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:22 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38.56b594c4-56b6-489f-886c-c59095409440" returned: 0 in 0.302s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-56b594c4-56b6-489f-886c-c59095409440" released by "_delete_snapshot" :: held 1.598s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:22 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2aa8e63a-8aac-4051-839c-a5145480292e" returned: 0 in 0.327s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" released by "delete_snapshot" :: held 1.630s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-2aa8e63a-8aac-4051-839c-a5145480292e" released by "delete_volume" :: held 0.797s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Created reservations ['67914658-005e-42b6-824d-e0600df37c9b', '9cf537b5-673b-4713-85dd-f45ea6a9e2e2', '30d07d81-6436-4345-bd00-6b095d6ccdce', 'a468883f-11fb-41ee-8f19-f48cc25d85ce'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Created reservations ['ec4e7c12-54bc-42d2-8da2-a09925e52b36', '9ab5e080-0942-44b6-a869-645dd1810eb7', '1528e8cf-707e-4e57-9eef-124e985766d2', '3729ec1d-71de-41f8-b262-d158ae1c3f7d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:22 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Delete snapshot completed successfully.
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-56b594c4-56b6-489f-886c-c59095409440-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Snapshots deleted, issuing volume delete {{(pid=87418) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c7b71-0171-4f89-ba0c-cc5955e9fa3b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:22 devstack sudo[101533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:22 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:22 devstack sudo[101534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38
Sep 30 18:03:22 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:23 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.657s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Deleted volume successfully.
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9688bc1d-9707-411e-9c0f-f20ed03ef337 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-2aa8e63a-8aac-4051-839c-a5145480292e-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:23 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38" returned: 0 in 0.777s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:23 devstack sudo[101548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38
Sep 30 18:03:23 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (b4b2dcfa-9967-42db-a62d-2224e2c12b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebbfaed-6d7f-4b1d-ab11-531e2f20634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebbfaed-6d7f-4b1d-ab11-531e2f20634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238407642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f33e75-611a-48c0-a61e-07738038c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:23Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fdacee-4f59-40dc-bf66-b6d41f10987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fdacee-4f59-40dc-bf66-b6d41f10987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38cd5af-552e-4eb4-98f3-7bcd906061a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38cd5af-552e-4eb4-98f3-7bcd906061a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f33e75-611a-48c0-a61e-07738038c3b0', 'volume_name': 'volume-15f33e75-611a-48c0-a61e-07738038c3b0', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742721c4-5846-4d4f-850d-44c8a3ae68d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742721c4-5846-4d4f-850d-44c8a3ae68d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10749d6e-cfca-456a-8518-e518b4cec773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Volume 15f33e75-611a-48c0-a61e-07738038c3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f33e75-611a-48c0-a61e-07738038c3b0', 'volume_size': 1}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238407642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f33e75-611a-48c0-a61e-07738038c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:23Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Creating volume 15f33e75-611a-48c0-a61e-07738038c3b0 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:23 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7f07b735-956c-402c-bda5-c5c754745d9b req-124ce1f3-3d65-49ad-b3fd-3608edab9afb tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:23 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0 1073741824
Sep 30 18:03:23 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:23 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4ccaa52-e4cf-4d74-8624-504471778b38" returned: 0 in 0.285s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-e4ccaa52-e4cf-4d74-8624-504471778b38" released by "delete_volume" :: held 1.202s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Created reservations ['c1117497-dc99-4b79-ad52-9d10d40260ca', '64c364b9-aa4a-4947-84fc-c73874fd60e5', 'ccf130a8-b2be-428a-bf7c-90ebf277b57d', '1d172360-e128-48af-abdf-d776da3bbcd4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:23 devstack sudo[101554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:23 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:24 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0 1073741824" returned: 0 in 0.453s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:24 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.289s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Deleted volume successfully.
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff3193a5-8ec7-481f-870b-5a94f407e00f tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-e4ccaa52-e4cf-4d74-8624-504471778b38-delete_volume" released by "delete_volume" :: held 5.509s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:24 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0
Sep 30 18:03:24 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:24 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7f07b735-956c-402c-bda5-c5c754745d9b req-124ce1f3-3d65-49ad-b3fd-3608edab9afb tempest-TestStampPattern-1947875384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.783s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10749d6e-cfca-456a-8518-e518b4cec773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f33e75-611a-48c0-a61e-07738038c3b0', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a018ce5-07fc-4de7-97f3-9749d938c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7f07b735-956c-402c-bda5-c5c754745d9b req-124ce1f3-3d65-49ad-b3fd-3608edab9afb tempest-TestStampPattern-1947875384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:24 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Volume volume-15f33e75-611a-48c0-a61e-07738038c3b0 (15f33e75-611a-48c0-a61e-07738038c3b0): created successfully
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a018ce5-07fc-4de7-97f3-9749d938c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (b4b2dcfa-9967-42db-a62d-2224e2c12b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-7f07b735-956c-402c-bda5-c5c754745d9b req-124ce1f3-3d65-49ad-b3fd-3608edab9afb tempest-TestStampPattern-1947875384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-2bc7a21b-0e71-416b-ba07-699779afcbd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '849ccf7c-53e8-4fb5-b87f-58f8e8433e30', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:03:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-262f9a9a-aac7-48df-8693-a929b6fa7e30 tempest-VolumesActionsTest-1002174928 None] Created volume successfully.
Sep 30 18:03:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-7f07b735-956c-402c-bda5-c5c754745d9b req-124ce1f3-3d65-49ad-b3fd-3608edab9afb tempest-TestStampPattern-1947875384 None] attachment_update completed successfully.
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Flow 'volume_create_manager' (4b7be1fe-212c-4ac6-b35b-22acf723b4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edecdba4-75be-4f6b-8416-0b700feaeba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edecdba4-75be-4f6b-8416-0b700feaeba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-222885444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53398d0-ee90-4e39-9d7b-448806506602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d781227cc4794e0b8d40ee5a7192664d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:25Z,use_quota=True,user_id='2e47b20f3fd54c97945acafc5baeb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f3ca50-4300-4103-9273-7e69779bf3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f3ca50-4300-4103-9273-7e69779bf3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57cad23-6738-41f4-b4aa-1236013f655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57cad23-6738-41f4-b4aa-1236013f655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53398d0-ee90-4e39-9d7b-448806506602', 'volume_name': 'volume-f53398d0-ee90-4e39-9d7b-448806506602', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b4fb3-d3dc-463c-8fa1-b1a5269a39bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b4fb3-d3dc-463c-8fa1-b1a5269a39bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a61b2a6-95e5-43fa-b9c4-306fca866f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:25 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Volume f53398d0-ee90-4e39-9d7b-448806506602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53398d0-ee90-4e39-9d7b-448806506602', 'volume_size': 1}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-222885444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53398d0-ee90-4e39-9d7b-448806506602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d781227cc4794e0b8d40ee5a7192664d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:25Z,use_quota=True,user_id='2e47b20f3fd54c97945acafc5baeb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Creating volume f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:25 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:25 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 1073741824
Sep 30 18:03:25 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:25 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 1073741824" returned: 0 in 0.577s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-15f33e75-611a-48c0-a61e-07738038c3b0-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-15f33e75-611a-48c0-a61e-07738038c3b0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:25 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602
Sep 30 18:03:25 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-quobyte-15f33e75-611a-48c0-a61e-07738038c3b0" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-15f33e75-611a-48c0-a61e-07738038c3b0" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85d1d6d-c5e0-4965-b6c6-333e6ab19854]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:26 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0
Sep 30 18:03:26 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:26 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602" returned: 0 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a61b2a6-95e5-43fa-b9c4-306fca866f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53398d0-ee90-4e39-9d7b-448806506602', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff87baa-83eb-45a0-8788-9658587e78a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Volume volume-f53398d0-ee90-4e39-9d7b-448806506602 (f53398d0-ee90-4e39-9d7b-448806506602): created successfully
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff87baa-83eb-45a0-8788-9658587e78a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Flow 'volume_create_manager' (4b7be1fe-212c-4ac6-b35b-22acf723b4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-13389a2c-bf44-4bd7-bda7-45f30584765a tempest-VolumesDeleteCascade-568309283 None] Created volume successfully.
Sep 30 18:03:26 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0" returned: 0 in 0.493s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:26 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0
Sep 30 18:03:26 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:26 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-15f33e75-611a-48c0-a61e-07738038c3b0" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-15f33e75-611a-48c0-a61e-07738038c3b0" released by "delete_volume" :: held 0.819s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Created reservations ['6c84b0e2-d8e2-48fe-bdb8-660610846672', '594b3f16-d439-4eb1-8ddd-8702b2024cdf', '14aea937-2682-49d8-b2aa-2ea8ab44f552', 'a94ef003-d3e1-4b6e-89ae-8fdac98ad179'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:26 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:26 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:27 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Deleted volume successfully.
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aed01c79-fc4e-49d8-a1cd-8a70f55b5e92 tempest-VolumesActionsTest-2061584223 None] Lock "cinder-15f33e75-611a-48c0-a61e-07738038c3b0-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Creating offline snapshot ecd725ac-d042-4737-a2a4-09868657a44a of volume f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e936c3-ca28-4e8f-b2ae-9302e46040cf]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:27 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602
Sep 30 18:03:27 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (78474481-def1-4d39-bb3a-5bb2a3263025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21799f6-0cff-49de-94b3-427f81950f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21799f6-0cff-49de-94b3-427f81950f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1867894054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1276a3-7eb1-4d96-99e5-b74520ea606c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:28Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa9f4ea-b70a-4826-b309-fdea17c15153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa9f4ea-b70a-4826-b309-fdea17c15153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efb5922-071a-4653-ad80-66db778e6364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efb5922-071a-4653-ad80-66db778e6364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1276a3-7eb1-4d96-99e5-b74520ea606c', 'volume_name': 'volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96c134-67be-4fe7-98d5-94e4bceedaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96c134-67be-4fe7-98d5-94e4bceedaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c736fe9a-f7e6-4a97-b7b1-ee9cc32679e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Volume 6b1276a3-7eb1-4d96-99e5-b74520ea606c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c', 'volume_size': 1}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:27 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602" returned: 0 in 0.432s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:27 devstack sudo[102048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a 1G
Sep 30 18:03:27 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-fa74e214-7cad-4e19-adab-98a77908c698 req-a4183b7b-3787-44de-bf74-4e3aac26b2b4 tempest-TestStampPattern-1947875384 None] Terminate volume connection completed successfully.
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-fa74e214-7cad-4e19-adab-98a77908c698 req-a4183b7b-3787-44de-bf74-4e3aac26b2b4 tempest-TestStampPattern-1947875384 None] Deleting attachment 849ccf7c-53e8-4fb5-b87f-58f8e8433e30. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:03:28 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a 1G" returned: 0 in 0.445s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f53398d0-ee90-4e39-9d7b-448806506602 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:28 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f53398d0-ee90-4e39-9d7b-448806506602 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a
Sep 30 18:03:28 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:28 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f53398d0-ee90-4e39-9d7b-448806506602 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a" returned: 0 in 0.292s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:28 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a is being set with open permissions: ugo+rw
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:28 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a
Sep 30 18:03:28 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:28 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a" returned: 0 in 0.235s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:28 devstack sudo[102090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info
Sep 30 18:03:28 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:29 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:29 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info is being set with open permissions: ugo+rw
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:29 devstack sudo[102093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info
Sep 30 18:03:29 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:29 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.info" returned: 0 in 0.271s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1867894054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1276a3-7eb1-4d96-99e5-b74520ea606c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:28Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Creating volume 6b1276a3-7eb1-4d96-99e5-b74520ea606c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:29 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:29 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c 1073741824
Sep 30 18:03:29 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c296f97c-d690-4ae0-94b5-101a213bc217 tempest-VolumesDeleteCascade-568309283 None] Create snapshot completed successfully
Sep 30 18:03:30 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c 1073741824" returned: 0 in 0.580s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:30 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c
Sep 30 18:03:30 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:30 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c" returned: 0 in 0.328s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c736fe9a-f7e6-4a97-b7b1-ee9cc32679e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b8c7eb-ca36-4ee3-9412-5994b3d1a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:30 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Volume volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c (6b1276a3-7eb1-4d96-99e5-b74520ea606c): created successfully
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b8c7eb-ca36-4ee3-9412-5994b3d1a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (78474481-def1-4d39-bb3a-5bb2a3263025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-127823ba-890c-44e3-bdc3-0c0bf1eb1fa6 tempest-VolumesActionsTest-1002174928 None] Created volume successfully.
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-6b1276a3-7eb1-4d96-99e5-b74520ea606c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Lock "cinder-6b1276a3-7eb1-4d96-99e5-b74520ea606c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Acquiring lock "cinder-quobyte-6b1276a3-7eb1-4d96-99e5-b74520ea606c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-6b1276a3-7eb1-4d96-99e5-b74520ea606c" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e79e7-7df3-4ef6-a65b-f74f8afd91de]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Flow 'volume_create_manager' (7c901b44-0cb8-4036-acfa-98562a4b2fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9b6dab-1fed-4fd3-9486-89489514d858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9b6dab-1fed-4fd3-9486-89489514d858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2073072462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c68bba-55b1-4e60-9dc0-9f2783ce6f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d781227cc4794e0b8d40ee5a7192664d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecd725ac-d042-4737-a2a4-09868657a44a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:31Z,use_quota=True,user_id='2e47b20f3fd54c97945acafc5baeb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:31 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c
Sep 30 18:03:31 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2f9c00-4cc9-435a-afd8-c6bbbe991818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2f9c00-4cc9-435a-afd8-c6bbbe991818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c29c1e-955f-4d95-b2c5-113a8961fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c29c1e-955f-4d95-b2c5-113a8961fc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39c68bba-55b1-4e60-9dc0-9f2783ce6f1c', 'volume_name': 'volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c', 'volume_size': 1, 'snapshot_id': 'ecd725ac-d042-4737-a2a4-09868657a44a'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989c27ad-1ba3-4f1a-957f-fa7ca60f5102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989c27ad-1ba3-4f1a-957f-fa7ca60f5102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90741459-2b93-4700-8a78-4be06f19c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Volume 39c68bba-55b1-4e60-9dc0-9f2783ce6f1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c', 'volume_size': 1, 'snapshot_id': 'ecd725ac-d042-4737-a2a4-09868657a44a'}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-ecd725ac-d042-4737-a2a4-09868657a44a-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-ecd725ac-d042-4737-a2a4-09868657a44a-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Creating volume 39c68bba-55b1-4e60-9dc0-9f2783ce6f1c from snapshot ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] snapshot: ecd725ac-d042-4737-a2a4-09868657a44a, volume: 39c68bba-55b1-4e60-9dc0-9f2783ce6f1c,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[86346b0c-fd0f-493b-bd66-4f85bd2eef9d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:31 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a
Sep 30 18:03:31 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:31 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c" returned: 0 in 0.499s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:31 devstack sudo[102144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c
Sep 30 18:03:31 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:31 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:31 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a" returned: 0 in 0.436s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6b1276a3-7eb1-4d96-99e5-b74520ea606c" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f53398d0-ee90-4e39-9d7b-448806506602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe18e0-f7bd-4e85-973a-ce92b1a49480]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Lock "cinder-quobyte-6b1276a3-7eb1-4d96-99e5-b74520ea606c" released by "delete_volume" :: held 0.866s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Created reservations ['062784aa-e745-4cf7-ad3f-86d8739c1551', '0ca5460d-31e0-40f6-89ac-013dc8accff8', '3d92c07a-5a64-4aab-b9eb-3070df248be2', 'a7df7169-68a9-4f7b-8fcd-86ce4bf56ff1'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:32 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602
Sep 30 18:03:32 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:32 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:32 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:32 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602" returned: 0 in 0.451s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:32 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c
Sep 30 18:03:32 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:32 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-2bc7a21b-0e71-416b-ba07-699779afcbd9-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.277s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Deleted volume successfully.
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Lock "cinder-2bc7a21b-0e71-416b-ba07-699779afcbd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2312d36c-07b2-4450-9f59-af6e412135af tempest-VolumesActionsTest-2061584223 None] Lock "cinder-6b1276a3-7eb1-4d96-99e5-b74520ea606c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-quobyte-2bc7a21b-0e71-416b-ba07-699779afcbd9" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-2bc7a21b-0e71-416b-ba07-699779afcbd9" acquired by "delete_volume" :: waited 0.013s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9588b-5512-4331-8774-867c2b05631d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:32 devstack sudo[102162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9
Sep 30 18:03:32 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:33 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:33 devstack sudo[102179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9
Sep 30 18:03:33 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:33 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2bc7a21b-0e71-416b-ba07-699779afcbd9" returned: 0 in 0.475s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-2bc7a21b-0e71-416b-ba07-699779afcbd9" released by "delete_volume" :: held 0.982s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Created reservations ['31e0e764-e3b5-4a4f-972f-c02335d82564', 'b5c5ab70-d105-4b3d-b363-241b90a86a9a', '7512a6bb-0ff6-4d45-928d-6007f9567d65', '0e732ecb-114d-409b-b089-ce4ca5bfe146'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:33 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:33 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:34 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.458s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Deleted volume successfully.
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-70a984ae-8bb7-42b6-8748-ec8f2eb9d584 tempest-TestStampPattern-1947875384 None] Lock "cinder-2bc7a21b-0e71-416b-ba07-699779afcbd9-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (551562f5-3833-44b4-905e-df7939dc2c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6211d48c-9434-4a54-b63d-d92dc60c9225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6211d48c-9434-4a54-b63d-d92dc60c9225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1450580458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588bed2-f077-44c5-9003-96f240840ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:34Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239bbd3f-4231-4223-bf9d-e76a2e8e89ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239bbd3f-4231-4223-bf9d-e76a2e8e89ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae265dd7-64ad-49ba-8782-a0ac69ef3dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae265dd7-64ad-49ba-8782-a0ac69ef3dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c588bed2-f077-44c5-9003-96f240840ee4', 'volume_name': 'volume-c588bed2-f077-44c5-9003-96f240840ee4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d7db8e-b8f6-4788-a1de-d21001494431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d7db8e-b8f6-4788-a1de-d21001494431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4214accd-613a-4d29-be6e-a9bc9ef83b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Volume c588bed2-f077-44c5-9003-96f240840ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c588bed2-f077-44c5-9003-96f240840ee4', 'volume_size': 1}
Sep 30 18:03:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-5f7c759c-6a50-46ab-ae0f-deed29851a42-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Lock "cinder-5f7c759c-6a50-46ab-ae0f-deed29851a42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-quobyte-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-quobyte-5f7c759c-6a50-46ab-ae0f-deed29851a42" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f7c759c-6a50-46ab-ae0f-deed29851a42" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Deleting offline snapshot 5f7c759c-6a50-46ab-ae0f-deed29851a42 of volume 5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] snapshot_file for this snap is: volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c7e784-7f52-4e3a-a7c6-e6ac7d3c5079]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:35 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42
Sep 30 18:03:35 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:36 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42" returned: 0 in 0.706s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e467557-119f-4d1a-b585-2482923713ca]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:36 devstack sudo[102195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e
Sep 30 18:03:36 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:37 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" returned: 0 in 0.884s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:37 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42
Sep 30 18:03:37 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:38 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42" returned: 0 in 0.663s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:38 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42
Sep 30 18:03:38 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:38 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e.5f7c759c-6a50-46ab-ae0f-deed29851a42" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f7c759c-6a50-46ab-ae0f-deed29851a42" released by "_delete_snapshot" :: held 3.011s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" released by "delete_snapshot" :: held 3.056s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Flow 'volume_create_manager' (8e839fe1-5b3a-4dd7-ad0f-c976e4a0aa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766526b3-b29c-4c42-b114-f2d010f8065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766526b3-b29c-4c42-b114-f2d010f8065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1104456853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f397d2cb-e41c-47bc-a249-5ff753477990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ae59c97b5b45d6bcd762af00f930fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:39Z,use_quota=True,user_id='eadb266e29c04b359bfcff019869d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4faa5fa3-0dc4-4ee5-bc7c-78754119c985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4faa5fa3-0dc4-4ee5-bc7c-78754119c985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86179ceb-9a71-4d8e-bfc6-6b8cd40e0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86179ceb-9a71-4d8e-bfc6-6b8cd40e0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f397d2cb-e41c-47bc-a249-5ff753477990', 'volume_name': 'volume-f397d2cb-e41c-47bc-a249-5ff753477990', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0a3bdc-d2a7-4c13-a994-ff4d12425983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0a3bdc-d2a7-4c13-a994-ff4d12425983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e523bc2-9c6b-4030-a449-f8e2bc837853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:38 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Volume f397d2cb-e41c-47bc-a249-5ff753477990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f397d2cb-e41c-47bc-a249-5ff753477990', 'volume_size': 1}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:38 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Created reservations ['c37d8293-9de0-4c59-b649-7fe0959521ff', '11e6ec45-e8e8-4247-bf28-db460c99c54b', 'b3de67e5-c470-478b-b2f4-6a4766328039', '0928fe7a-fee6-40e8-9e53-3ba9085e5c43'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Delete snapshot completed successfully.
Sep 30 18:03:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6c363a92-78e6-4639-ab14-ac2edc957cca tempest-TestStampPattern-1947875384 None] Lock "cinder-5f7c759c-6a50-46ab-ae0f-deed29851a42-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:40 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" returned: 0 in 7.742s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:03:40 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Converted 1024.00 MB image at 132.23 MB/s
Sep 30 18:03:40 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c is being set with open permissions: ugo+rw
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:40 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c
Sep 30 18:03:40 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:40 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" returned: 0 in 0.248s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" released by "_copy_volume_from_snapshot" :: held 8.986s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-ecd725ac-d042-4737-a2a4-09868657a44a-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" released by "_create_volume_from_snapshot" :: held 9.048s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.066s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.810s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1450580458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588bed2-f077-44c5-9003-96f240840ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ca7073ff14d548bc0f0e2caf83943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:34Z,use_quota=True,user_id='0aa5bc23253c4ee99d8c819c2c6a5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Creating volume c588bed2-f077-44c5-9003-96f240840ee4 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:40 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:40 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4 1073741824
Sep 30 18:03:40 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90741459-2b93-4700-8a78-4be06f19c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c', 'volume_size': 1, 'snapshot_id': 'ecd725ac-d042-4737-a2a4-09868657a44a'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7325b14e-cc97-42d3-93ab-f18eae45538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:40 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Volume volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c (39c68bba-55b1-4e60-9dc0-9f2783ce6f1c): created successfully
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7325b14e-cc97-42d3-93ab-f18eae45538f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:40 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Flow 'volume_create_manager' (7c901b44-0cb8-4036-acfa-98562a4b2fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:40 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-721dfe29-a64d-42a3-93d7-b4259f511783 tempest-VolumesDeleteCascade-568309283 None] Created volume successfully.
Sep 30 18:03:41 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4 1073741824" returned: 0 in 0.653s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:41 devstack sudo[102222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4
Sep 30 18:03:41 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-f53398d0-ee90-4e39-9d7b-448806506602-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-f53398d0-ee90-4e39-9d7b-448806506602-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:41 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4" returned: 0 in 0.312s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1104456853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f397d2cb-e41c-47bc-a249-5ff753477990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ae59c97b5b45d6bcd762af00f930fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:39Z,use_quota=True,user_id='eadb266e29c04b359bfcff019869d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Creating volume f397d2cb-e41c-47bc-a249-5ff753477990 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:41 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Performing cascade delete. {{(pid=87418) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 30 18:03:41 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990 1073741824
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4214accd-613a-4d29-be6e-a9bc9ef83b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c588bed2-f077-44c5-9003-96f240840ee4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:41 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c381555f-e7aa-4692-af0b-ed138016d6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-ecd725ac-d042-4737-a2a4-09868657a44a-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:41 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Volume volume-c588bed2-f077-44c5-9003-96f240840ee4 (c588bed2-f077-44c5-9003-96f240840ee4): created successfully
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c381555f-e7aa-4692-af0b-ed138016d6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Flow 'volume_create_manager' (551562f5-3833-44b4-905e-df7939dc2c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-ecd725ac-d042-4737-a2a4-09868657a44a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-f53398d0-ee90-4e39-9d7b-448806506602" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-730eb553-8e11-4264-b7c9-3cf21b8d81b7 tempest-VolumesActionsTest-1002174928 None] Created volume successfully.
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-f53398d0-ee90-4e39-9d7b-448806506602" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-ecd725ac-d042-4737-a2a4-09868657a44a" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-ecd725ac-d042-4737-a2a4-09868657a44a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Deleting offline snapshot ecd725ac-d042-4737-a2a4-09868657a44a of volume f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] snapshot_file for this snap is: volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f78ed1-716e-4f87-94e0-6a3c63af9ba7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:41 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a
Sep 30 18:03:41 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:42 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990 1073741824" returned: 0 in 0.800s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:42 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a" returned: 0 in 0.493s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f53398d0-ee90-4e39-9d7b-448806506602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfadb3ac-12f9-4bde-86cc-09c67cda775a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:42 devstack sudo[102267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990
Sep 30 18:03:42 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:42 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602
Sep 30 18:03:42 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:42 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990" returned: 0 in 0.362s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e523bc2-9c6b-4030-a449-f8e2bc837853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f397d2cb-e41c-47bc-a249-5ff753477990', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b273e73a-91e1-400b-92f9-8ef5e6ce4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:42 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Volume volume-f397d2cb-e41c-47bc-a249-5ff753477990 (f397d2cb-e41c-47bc-a249-5ff753477990): created successfully
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b273e73a-91e1-400b-92f9-8ef5e6ce4062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Flow 'volume_create_manager' (8e839fe1-5b3a-4dd7-ad0f-c976e4a0aa4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-06147d4c-9992-4116-8046-b960a25d006a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Created volume successfully.
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Acquiring lock "cinder-c588bed2-f077-44c5-9003-96f240840ee4-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Lock "cinder-c588bed2-f077-44c5-9003-96f240840ee4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Acquiring lock "cinder-quobyte-c588bed2-f077-44c5-9003-96f240840ee4" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Lock "cinder-quobyte-c588bed2-f077-44c5-9003-96f240840ee4" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5d3c3d-64a4-48eb-b322-caed66ed83b9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:43 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602" returned: 0 in 0.903s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:43 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a
Sep 30 18:03:43 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:43 devstack sudo[102278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4
Sep 30 18:03:43 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:43 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:43 devstack sudo[102289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4
Sep 30 18:03:43 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:43 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a" returned: 0 in 0.520s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:43 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a
Sep 30 18:03:43 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:44 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c588bed2-f077-44c5-9003-96f240840ee4" returned: 0 in 0.349s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Lock "cinder-quobyte-c588bed2-f077-44c5-9003-96f240840ee4" released by "delete_volume" :: held 0.878s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:44 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602.ecd725ac-d042-4737-a2a4-09868657a44a" returned: 0 in 0.330s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Lock "cinder-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-e4fc8a02-8afa-4f6a-859f-f03878f9571a req-4b1c6ef2-8924-4703-aae6-67016037c84e tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-e4fc8a02-8afa-4f6a-859f-f03878f9571a req-4b1c6ef2-8924-4703-aae6-67016037c84e tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-ecd725ac-d042-4737-a2a4-09868657a44a" released by "_delete_snapshot" :: held 2.421s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-f53398d0-ee90-4e39-9d7b-448806506602" released by "delete_snapshot" :: held 2.470s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-e4fc8a02-8afa-4f6a-859f-f03878f9571a req-4b1c6ef2-8924-4703-aae6-67016037c84e tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.091s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Created reservations ['f886c409-17cf-4f77-8a33-badb9b44d277', '94cafd80-ff87-46eb-b4b7-fc5a8a6ccf97', '1c2f5509-1a6e-4992-9467-d227928c93f4', '696091b6-9ffd-43d6-a33f-62e53e8f63a9'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Acquiring lock "cinder-quobyte-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-e4fc8a02-8afa-4f6a-859f-f03878f9571a req-4b1c6ef2-8924-4703-aae6-67016037c84e tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-f397d2cb-e41c-47bc-a249-5ff753477990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64809e7d-59fb-45cd-b7a6-191ebfe019fb', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a8534-9b01-45bb-8b2a-bd4e68767480]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-e4fc8a02-8afa-4f6a-859f-f03878f9571a req-4b1c6ef2-8924-4703-aae6-67016037c84e tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] attachment_update completed successfully.
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Created reservations ['5deacfc4-0c46-4830-9326-865c89358100', '60b6c7f4-d89b-44b8-8969-4d7d55876fc3', '294569f1-d25d-4c04-8479-f9f75bdb47be', 'bc33ef2b-449e-4741-bcbb-b7c48f3b01d3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:44 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:44 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:44 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e
Sep 30 18:03:44 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Delete snapshot completed successfully.
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-ecd725ac-d042-4737-a2a4-09868657a44a-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Snapshots deleted, issuing volume delete {{(pid=87418) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-f53398d0-ee90-4e39-9d7b-448806506602" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-f53398d0-ee90-4e39-9d7b-448806506602" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f63a210-908b-456e-85ea-635cbf0ffd6c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:44 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Deleted volume successfully.
Sep 30 18:03:44 devstack sudo[102385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602
Sep 30 18:03:44 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:44 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-787a647b-916f-4133-9188-88fcf4907c3b tempest-VolumesActionsTest-1002174928 None] Lock "cinder-c588bed2-f077-44c5-9003-96f240840ee4-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" returned: 0 in 0.512s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:44 devstack sudo[102728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e
Sep 30 18:03:44 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:45 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602" returned: 0 in 0.458s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:45 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" returned: 0 in 0.293s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:45 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602
Sep 30 18:03:45 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Lock "cinder-quobyte-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e" released by "delete_volume" :: held 0.890s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Created reservations ['db131785-92a5-492a-a832-a89661e52e23', 'bc4041f6-08bc-4d16-bd7d-70371cb71aa6', '8b8d10c2-daac-4dbf-9f9e-c83f4b5c8ebb', '16940e3b-1d85-4898-9454-616e0184647e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:45 devstack sudo[102742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:45 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:45 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f53398d0-ee90-4e39-9d7b-448806506602" returned: 0 in 0.392s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-f53398d0-ee90-4e39-9d7b-448806506602" released by "delete_volume" :: held 0.984s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Created reservations ['7d6fa896-a2f8-4e8a-a54f-2c485857dfe1', 'a01b5dd1-1ea4-4756-9f77-3218fd99773a', 'abccd68b-7ee5-4f97-8a31-f88b45c91752', 'd8dec7ab-d428-4d73-9a64-1e869bbe9856'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:45 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.369s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:45 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Deleted volume successfully.
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-179d3ffc-5dba-4730-8c95-8eee5cf33deb tempest-TestStampPattern-1947875384 None] Lock "cinder-5f5b406e-2e37-46a1-825f-5a5b3ad28e1e-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:45 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:45 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "cinder-quobyte-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[789a249f-ada9-489f-8ebc-5eba9438f0e6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:46 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.431s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:46 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Deleted volume successfully.
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04c36576-d024-4de5-bb6f-d6addb13e121 tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-f53398d0-ee90-4e39-9d7b-448806506602-delete_volume" released by "delete_volume" :: held 4.926s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:46 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:46 devstack sudo[102759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c
Sep 30 18:03:46 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:46 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:46 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.403s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:03:46 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" returned: 0 in 0.565s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:46 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c
Sep 30 18:03:46 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:47 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" returned: 0 in 0.460s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-quobyte-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c" released by "delete_volume" :: held 1.094s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Created reservations ['4756461b-ac08-4be5-8a57-f73f4f328872', '0ae91b5e-91c9-4e9d-b750-477078bd515d', '3bdeb746-c9ec-449d-930d-c028d812e5b0', 'a5964204-7f06-4c02-a431-544954ff2b11'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:47 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:47 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:47 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.394s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Deleted volume successfully.
Sep 30 18:03:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ced248eb-0c36-4e8f-a2d0-9a2a1c02e6bc tempest-VolumesDeleteCascade-568309283 None] Lock "cinder-39c68bba-55b1-4e60-9dc0-9f2783ce6f1c-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-8a96559d-eae4-430e-90b2-a428fb905221 req-48b937bc-09e7-4841-97f8-e3cfaa05ec6a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Terminate volume connection completed successfully.
Sep 30 18:03:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-8a96559d-eae4-430e-90b2-a428fb905221 req-48b937bc-09e7-4841-97f8-e3cfaa05ec6a tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Deleting attachment 64809e7d-59fb-45cd-b7a6-191ebfe019fb. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Acquiring lock "cinder-f397d2cb-e41c-47bc-a249-5ff753477990-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "cinder-f397d2cb-e41c-47bc-a249-5ff753477990-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Acquiring lock "cinder-quobyte-f397d2cb-e41c-47bc-a249-5ff753477990" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "cinder-quobyte-f397d2cb-e41c-47bc-a249-5ff753477990" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c015b2-047e-474d-ac5f-eabd13dff835]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:49 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990
Sep 30 18:03:49 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:49 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990" returned: 0 in 0.372s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:49 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990
Sep 30 18:03:49 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:49 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f397d2cb-e41c-47bc-a249-5ff753477990" returned: 0 in 0.258s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "cinder-quobyte-f397d2cb-e41c-47bc-a249-5ff753477990" released by "delete_volume" :: held 0.682s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:49 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Created reservations ['79e5c768-4fb6-4895-babd-24c8debaebf4', '1e7af599-2d1e-497b-bdc1-20cc63061bc6', 'a9913304-7bda-4b19-8fa2-0c84e32cb732', 'e0eef55e-4b0c-4320-aa26-91cef40588c3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:50 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:50 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:50 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Deleted volume successfully.
Sep 30 18:03:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-58b0fc16-3b71-429b-a2fc-57ba71bc7884 tempest-TestServerVolumeAttachScenarioOldVersion-1203021300 None] Lock "cinder-f397d2cb-e41c-47bc-a249-5ff753477990-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Flow 'volume_create_manager' (48aaca66-097e-43e8-a0b4-817ded12feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb7d33f-dc90-40e8-bc05-49a49f725a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb7d33f-dc90-40e8-bc05-49a49f725a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-133478146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aabf4a9-2410-4c12-a64a-50d4facf548e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ec22839ef584656bf2ea290c693bfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:54Z,use_quota=True,user_id='377d69e49cef491a91a309c8673f8b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6febbdc-eaf2-4d91-bc54-e4e67ef525c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6febbdc-eaf2-4d91-bc54-e4e67ef525c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d23ee51-3f27-4499-9186-ff6e356dda1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d23ee51-3f27-4499-9186-ff6e356dda1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aabf4a9-2410-4c12-a64a-50d4facf548e', 'volume_name': 'volume-5aabf4a9-2410-4c12-a64a-50d4facf548e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28afb26b-06c5-405a-82d7-9d2db4ac6aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28afb26b-06c5-405a-82d7-9d2db4ac6aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae8834d-da7a-49e9-9e40-761ca56cdff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:53 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Volume 5aabf4a9-2410-4c12-a64a-50d4facf548e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aabf4a9-2410-4c12-a64a-50d4facf548e', 'volume_size': 1}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-133478146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aabf4a9-2410-4c12-a64a-50d4facf548e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ec22839ef584656bf2ea290c693bfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:03:54Z,use_quota=True,user_id='377d69e49cef491a91a309c8673f8b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Creating volume 5aabf4a9-2410-4c12-a64a-50d4facf548e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:03:53 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:03:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:53 devstack sudo[102878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e 1073741824
Sep 30 18:03:53 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:54 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e 1073741824" returned: 0 in 0.714s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:54 devstack sudo[102886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e
Sep 30 18:03:54 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:54 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e" returned: 0 in 0.268s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae8834d-da7a-49e9-9e40-761ca56cdff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aabf4a9-2410-4c12-a64a-50d4facf548e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e05ba17-a929-479c-92a6-e79680869aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:03:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Volume volume-5aabf4a9-2410-4c12-a64a-50d4facf548e (5aabf4a9-2410-4c12-a64a-50d4facf548e): created successfully
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e05ba17-a929-479c-92a6-e79680869aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:03:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Flow 'volume_create_manager' (48aaca66-097e-43e8-a0b4-817ded12feab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:03:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-101f534e-0bcd-4966-a34f-691caac248e8 tempest-VolumesMetadataTest-1403581158 None] Created volume successfully.
Sep 30 18:03:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Acquiring lock "cinder-5aabf4a9-2410-4c12-a64a-50d4facf548e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Lock "cinder-5aabf4a9-2410-4c12-a64a-50d4facf548e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Acquiring lock "cinder-quobyte-5aabf4a9-2410-4c12-a64a-50d4facf548e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:03:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Lock "cinder-quobyte-5aabf4a9-2410-4c12-a64a-50d4facf548e" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:03:56 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0655686a-5f39-45b6-a2fc-2bdb94216d6d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:03:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:56 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e
Sep 30 18:03:56 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:57 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e" returned: 0 in 0.425s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:57 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e
Sep 30 18:03:57 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:57 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5aabf4a9-2410-4c12-a64a-50d4facf548e" returned: 0 in 0.277s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Lock "cinder-quobyte-5aabf4a9-2410-4c12-a64a-50d4facf548e" released by "delete_volume" :: held 0.776s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Created reservations ['4202a9da-d4a1-4c43-af0c-252cbfb21b96', 'af60b7e8-712b-42c8-bd8b-fef79fcc288a', '3acf8afb-092b-4562-b075-d5f83258d97c', '8feff571-0491-4427-9629-1040c6947c17'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:03:57 devstack sudo[102900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:03:57 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:03:57 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.293s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:03:57 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:03:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Deleted volume successfully.
Sep 30 18:03:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0dffb1d9-0098-46dd-a88f-a4506f198a1d tempest-VolumesMetadataTest-1403581158 None] Lock "cinder-5aabf4a9-2410-4c12-a64a-50d4facf548e-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=157,cinder:UPDATE=171,cinder:INSERT=44,cinder:DELETE=14 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=186,cinder:DELETE=15,cinder:SELECT=138,cinder:INSERT=43 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Flow 'volume_create_manager' (fe0a40e3-45a4-4a67-837f-422f91140f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08ccb36-9e64-4494-bc73-552427028294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08ccb36-9e64-4494-bc73-552427028294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1144285269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c274c7-b6c1-4651-8e85-0089b90eba0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f2c7ee19384d0ebe6f89571d1e29e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:05Z,use_quota=True,user_id='204d8ace4ae047dbaaeefb2a0741d475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb701f21-c2bf-419b-94db-b5ba6e5594d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb701f21-c2bf-419b-94db-b5ba6e5594d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc40a388-a5b5-4178-b9ec-ac15c78c351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc40a388-a5b5-4178-b9ec-ac15c78c351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c274c7-b6c1-4651-8e85-0089b90eba0c', 'volume_name': 'volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c', 'volume_size': 2}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c067c3a-a8cb-4d1c-a467-b613facbeb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c067c3a-a8cb-4d1c-a467-b613facbeb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9f2fc3-ac17-4f1f-b8d8-808af795a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:04 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Volume f1c274c7-b6c1-4651-8e85-0089b90eba0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c', 'volume_size': 2}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1144285269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c274c7-b6c1-4651-8e85-0089b90eba0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f2c7ee19384d0ebe6f89571d1e29e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:05Z,use_quota=True,user_id='204d8ace4ae047dbaaeefb2a0741d475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Creating volume f1c274c7-b6c1-4651-8e85-0089b90eba0c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:04 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c 2147483648 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:04 devstack sudo[102909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c 2147483648
Sep 30 18:04:04 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:05 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c 2147483648" returned: 0 in 0.699s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:05 devstack sudo[102915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c
Sep 30 18:04:05 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:05 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c" returned: 0 in 0.332s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9f2fc3-ac17-4f1f-b8d8-808af795a942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c', 'volume_size': 2}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea910114-afcd-4491-ae57-b06184716f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Volume volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c (f1c274c7-b6c1-4651-8e85-0089b90eba0c): created successfully
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea910114-afcd-4491-ae57-b06184716f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Flow 'volume_create_manager' (fe0a40e3-45a4-4a67-837f-422f91140f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c2d8b411-25ba-4e81-995b-24bc1e3261db tempest-VolumesCloneNegativeTest-1907399271 None] Created volume successfully.
Sep 30 18:04:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Acquiring lock "cinder-f1c274c7-b6c1-4651-8e85-0089b90eba0c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Lock "cinder-f1c274c7-b6c1-4651-8e85-0089b90eba0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Acquiring lock "cinder-quobyte-f1c274c7-b6c1-4651-8e85-0089b90eba0c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Lock "cinder-quobyte-f1c274c7-b6c1-4651-8e85-0089b90eba0c" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caa9527-f38f-4df1-a6a2-218af8ccd48d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:07 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c
Sep 30 18:04:07 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Flow 'volume_create_manager' (dbe84527-d52d-4768-a410-5d77b186ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad72b47-7b6f-42dd-90b0-aad815712340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:07 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad72b47-7b6f-42dd-90b0-aad815712340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1992863184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b6595e-be4a-4807-926f-61536286ac62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0a1487914464797d2213f74fa8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:07Z,use_quota=True,user_id='f216b5ecb3f344e7b20f698709855e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fcc0ab-5d7a-4b18-b2de-1edd4af8ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fcc0ab-5d7a-4b18-b2de-1edd4af8ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc696287-12ff-412a-8ffa-5b5a16b39495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc696287-12ff-412a-8ffa-5b5a16b39495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b6595e-be4a-4807-926f-61536286ac62', 'volume_name': 'volume-10b6595e-be4a-4807-926f-61536286ac62', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6b9031-6086-44a2-ac23-fd85515d7a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6b9031-6086-44a2-ac23-fd85515d7a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac92d4f-c957-4e0d-aec5-5a55e094f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:07 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Volume 10b6595e-be4a-4807-926f-61536286ac62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b6595e-be4a-4807-926f-61536286ac62', 'volume_size': 1}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1992863184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b6595e-be4a-4807-926f-61536286ac62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0a1487914464797d2213f74fa8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:07Z,use_quota=True,user_id='f216b5ecb3f344e7b20f698709855e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Creating volume 10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:07 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c" returned: 0 in 0.655s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:07 devstack sudo[102925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 1073741824
Sep 30 18:04:07 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:07 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c
Sep 30 18:04:07 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:08 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f1c274c7-b6c1-4651-8e85-0089b90eba0c" returned: 0 in 0.454s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Lock "cinder-quobyte-f1c274c7-b6c1-4651-8e85-0089b90eba0c" released by "delete_volume" :: held 1.199s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Created reservations ['233b2e40-d35d-47b8-b557-7861fe5c22c1', '1e228aab-3be8-4083-a1c4-9294459bb24c', '55873870-4fb0-45e7-a35f-91b25b91a217', '23b7f950-71cd-43fb-9262-7086606e0a2e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:08 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 1073741824" returned: 0 in 0.699s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:08 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:08 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:08 devstack sudo[102936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62
Sep 30 18:04:08 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:08 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Deleted volume successfully.
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-315d2037-ab05-441a-9f13-851d4e0305ea tempest-VolumesCloneNegativeTest-1907399271 None] Lock "cinder-f1c274c7-b6c1-4651-8e85-0089b90eba0c-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:08 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62" returned: 0 in 0.264s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac92d4f-c957-4e0d-aec5-5a55e094f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b6595e-be4a-4807-926f-61536286ac62', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c887af8-40e2-40e9-88e6-177bf264ab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Volume volume-10b6595e-be4a-4807-926f-61536286ac62 (10b6595e-be4a-4807-926f-61536286ac62): created successfully
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c887af8-40e2-40e9-88e6-177bf264ab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Flow 'volume_create_manager' (dbe84527-d52d-4768-a410-5d77b186ff59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-19bd8b5b-9a8a-4567-8ff0-ef1afb75db94 tempest-VolumeDependencyTests-1915415519 None] Created volume successfully.
Sep 30 18:04:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Creating offline snapshot 8051826f-1de4-4c15-a584-7615ef503e2e of volume 10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:04:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec9565-bad7-4f24-9dfa-0c6071f06431]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:09 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62
Sep 30 18:04:09 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:10 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62" returned: 0 in 0.571s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:10 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e 1G
Sep 30 18:04:10 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:10 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e 1G" returned: 0 in 0.522s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b6595e-be4a-4807-926f-61536286ac62 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:10 devstack sudo[102952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b6595e-be4a-4807-926f-61536286ac62 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e
Sep 30 18:04:10 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:11 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b6595e-be4a-4807-926f-61536286ac62 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e" returned: 0 in 0.411s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:11 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e is being set with open permissions: ugo+rw
Sep 30 18:04:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:11 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e
Sep 30 18:04:11 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:11 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e" returned: 0 in 0.268s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:11 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info
Sep 30 18:04:11 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:11 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info" returned: 0 in 0.330s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:11 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info is being set with open permissions: ugo+rw
Sep 30 18:04:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:12 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info
Sep 30 18:04:12 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:12 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.info" returned: 0 in 0.353s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3822f322-af3d-4125-b742-ae3cf862d565 tempest-VolumeDependencyTests-1915415519 None] Create snapshot completed successfully
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Flow 'volume_create_manager' (c9c5a889-19ad-42aa-9694-286754400df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10bf9c5-ce18-4e35-806a-a426697df545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10bf9c5-ce18-4e35-806a-a426697df545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-159037336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60e6932-75ab-4aa2-a216-40a6c5f1c1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3dae91ba97475c94087630870fe626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:12Z,use_quota=True,user_id='c404283e656446a098b83b9182a1a0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfed5b8-0768-4b38-a3dc-0dec7c9878d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfed5b8-0768-4b38-a3dc-0dec7c9878d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4e9881-080a-4ca0-b1b3-2fc0dff937b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4e9881-080a-4ca0-b1b3-2fc0dff937b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60e6932-75ab-4aa2-a216-40a6c5f1c1fc', 'volume_name': 'volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890418ad-0180-41ff-8b83-e7c4c213b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890418ad-0180-41ff-8b83-e7c4c213b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0655c2fd-ccaa-49d8-bcd5-3d0366b9d64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:12 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Volume f60e6932-75ab-4aa2-a216-40a6c5f1c1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc', 'volume_size': 1}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-159037336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60e6932-75ab-4aa2-a216-40a6c5f1c1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3dae91ba97475c94087630870fe626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:12Z,use_quota=True,user_id='c404283e656446a098b83b9182a1a0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Creating volume f60e6932-75ab-4aa2-a216-40a6c5f1c1fc {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:12 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:12 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc 1073741824
Sep 30 18:04:12 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:13 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc 1073741824" returned: 0 in 0.513s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:13 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc
Sep 30 18:04:13 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:13 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0655c2fd-ccaa-49d8-bcd5-3d0366b9d64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8d452c-1cdc-4b21-bb57-de303c33403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:13 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Volume volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc (f60e6932-75ab-4aa2-a216-40a6c5f1c1fc): created successfully
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8d452c-1cdc-4b21-bb57-de303c33403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Flow 'volume_create_manager' (c9c5a889-19ad-42aa-9694-286754400df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-81f6c303-c2e3-400f-a959-6a2ed27e2d5e tempest-AbsoluteLimitsTests-1081753480 None] Created volume successfully.
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Flow 'volume_create_manager' (94400441-f054-4721-9695-143c2f1f401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a710011-202b-44be-969a-b54630e5d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a710011-202b-44be-969a-b54630e5d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-860898099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d76d633-8bbb-4388-962d-2aade64cef9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0a1487914464797d2213f74fa8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8051826f-1de4-4c15-a584-7615ef503e2e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:14Z,use_quota=True,user_id='f216b5ecb3f344e7b20f698709855e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fa098b-ce16-4927-87e0-e84c9ed8b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fa098b-ce16-4927-87e0-e84c9ed8b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e35e9d-a0c2-43aa-99ec-e040f2eb64a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e35e9d-a0c2-43aa-99ec-e040f2eb64a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d76d633-8bbb-4388-962d-2aade64cef9b', 'volume_name': 'volume-0d76d633-8bbb-4388-962d-2aade64cef9b', 'volume_size': 1, 'snapshot_id': '8051826f-1de4-4c15-a584-7615ef503e2e'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71961176-efc4-4075-8d9a-a7f4f18631c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71961176-efc4-4075-8d9a-a7f4f18631c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36f5a91-7b0e-4151-a875-4ed51555f60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:13 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Volume 0d76d633-8bbb-4388-962d-2aade64cef9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d76d633-8bbb-4388-962d-2aade64cef9b', 'volume_size': 1, 'snapshot_id': '8051826f-1de4-4c15-a584-7615ef503e2e'}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-quobyte-8051826f-1de4-4c15-a584-7615ef503e2e-0d76d633-8bbb-4388-962d-2aade64cef9b" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-8051826f-1de4-4c15-a584-7615ef503e2e-0d76d633-8bbb-4388-962d-2aade64cef9b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Creating volume 0d76d633-8bbb-4388-962d-2aade64cef9b from snapshot 8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-quobyte-0d76d633-8bbb-4388-962d-2aade64cef9b" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-0d76d633-8bbb-4388-962d-2aade64cef9b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] snapshot: 8051826f-1de4-4c15-a584-7615ef503e2e, volume: 0d76d633-8bbb-4388-962d-2aade64cef9b,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc8e99-186e-4313-89b2-5bd8bb496069]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:14 devstack sudo[102975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e
Sep 30 18:04:14 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:14 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Flow 'volume_create_manager' (d6308913-47bb-4b74-828f-7f982b094a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416557ce-61f6-4ce3-b052-d066731fc9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e" returned: 0 in 0.565s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10b6595e-be4a-4807-926f-61536286ac62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416557ce-61f6-4ce3-b052-d066731fc9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1489179712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc06a77-56f9-4198-81ba-9034e62edf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9fa748457c45db97939546c0a92356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:14Z,use_quota=True,user_id='f88dfca4844149068fceaac42216700c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab9f507-b812-4d6e-bbf7-491c7e4fb09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab9f507-b812-4d6e-bbf7-491c7e4fb09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15d1b98-32fe-4ca7-ae71-45a026bc3e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0df178-ced5-4692-b6fe-d5d985e2f9e0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:14 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62
Sep 30 18:04:14 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15d1b98-32fe-4ca7-ae71-45a026bc3e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fc06a77-56f9-4198-81ba-9034e62edf57', 'volume_name': 'volume-6fc06a77-56f9-4198-81ba-9034e62edf57', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f204d10>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912e9337-48db-4f45-9405-059a737246c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912e9337-48db-4f45-9405-059a737246c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad6090f-2d0c-45f1-9552-ddd55c051694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:14 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Volume 6fc06a77-56f9-4198-81ba-9034e62edf57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fc06a77-56f9-4198-81ba-9034e62edf57', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f204d10>}
Sep 30 18:04:14 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Trying to clone 6fc06a77-56f9-4198-81ba-9034e62edf57 from image 90139efc-54c0-4670-ab72-2da0af285eb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:04:15 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62" returned: 0 in 0.569s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Acquiring lock "cinder-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:15 devstack sudo[102986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b
Sep 30 18:04:15 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Lock "cinder-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Acquiring lock "cinder-quobyte-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Lock "cinder-quobyte-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc" acquired by "delete_volume" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6466d4-482c-4791-88fe-5184a21d6f45]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:04:15 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c682e-c641-49dc-bded-19a1e1bd32cf]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:15 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc
Sep 30 18:04:15 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:15 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD
Sep 30 18:04:15 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:15 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:15 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc
Sep 30 18:04:15 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:15 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:15 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 is fetched for user f88dfca4844149068fceaac42216700c. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3908358-bfe6-4f77-831d-bafb5a98ec06]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:16 devstack sudo[103013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD
Sep 30 18:04:16 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:16 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc" returned: 0 in 0.562s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Lock "cinder-quobyte-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc" released by "delete_volume" :: held 1.111s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Created reservations ['a0d70b49-93f3-4a47-b1e6-0623a891cf04', 'f146fb56-2356-4855-92b5-fea945668199', '4276c058-5ad1-40df-bbed-36edba3d4a5c', 'dd3a5fac-aa42-4819-8e53-6b805a85d534'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:16 devstack sudo[103017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:16 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:16 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD" returned: 0 in 0.641s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:16 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.300s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:16 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Deleted volume successfully.
Sep 30 18:04:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1849cb39-0adf-4d95-80d7-de5605af0f0c tempest-AbsoluteLimitsTests-1081753480 None] Lock "cinder-f60e6932-75ab-4aa2-a216-40a6c5f1c1fc-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:23 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b" returned: 0 in 8.696s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:23 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:04:23 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Converted 1024.00 MB image at 117.74 MB/s
Sep 30 18:04:23 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b is being set with open permissions: ugo+rw
Sep 30 18:04:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:23 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b
Sep 30 18:04:23 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:24 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b" returned: 0 in 0.312s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-0d76d633-8bbb-4388-962d-2aade64cef9b" released by "_copy_volume_from_snapshot" :: held 10.277s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-8051826f-1de4-4c15-a584-7615ef503e2e-0d76d633-8bbb-4388-962d-2aade64cef9b" released by "_create_volume_from_snapshot" :: held 10.375s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.399s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.450s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1489179712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc06a77-56f9-4198-81ba-9034e62edf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9fa748457c45db97939546c0a92356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:14Z,use_quota=True,user_id='f88dfca4844149068fceaac42216700c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Creating volume 6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:24 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:24 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 1073741824
Sep 30 18:04:24 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36f5a91-7b0e-4151-a875-4ed51555f60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d76d633-8bbb-4388-962d-2aade64cef9b', 'volume_size': 1, 'snapshot_id': '8051826f-1de4-4c15-a584-7615ef503e2e'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d07a57-84d1-4c18-bf4b-e34adb84930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:24 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Volume volume-0d76d633-8bbb-4388-962d-2aade64cef9b (0d76d633-8bbb-4388-962d-2aade64cef9b): created successfully
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d07a57-84d1-4c18-bf4b-e34adb84930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Flow 'volume_create_manager' (94400441-f054-4721-9695-143c2f1f401c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5b63befb-370a-4a90-a85a-c4ff40eb250c tempest-VolumeDependencyTests-1915415519 None] Created volume successfully.
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-8051826f-1de4-4c15-a584-7615ef503e2e-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:24 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 1073741824" returned: 0 in 0.757s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-8051826f-1de4-4c15-a584-7615ef503e2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-quobyte-10b6595e-be4a-4807-926f-61536286ac62" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-10b6595e-be4a-4807-926f-61536286ac62" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-quobyte-8051826f-1de4-4c15-a584-7615ef503e2e" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-8051826f-1de4-4c15-a584-7615ef503e2e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Deleting offline snapshot 8051826f-1de4-4c15-a584-7615ef503e2e of volume 10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] snapshot_file for this snap is: volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa600ed1-f5c3-4cc7-8ab3-a28c85d44afa]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:25 devstack sudo[103035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57
Sep 30 18:04:25 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:25 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e
Sep 30 18:04:25 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:25 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Attempting download of 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume 6fc06a77-56f9-4198-81ba-9034e62edf57. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:04:25 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e" returned: 0 in 0.500s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10b6595e-be4a-4807-926f-61536286ac62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c5d509-8988-4ba0-abaa-d21520cc7056]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f42145-ef22-4f1b-910a-eeaf56500bff]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:25 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62
Sep 30 18:04:25 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:25 devstack sudo[103043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63
Sep 30 18:04:25 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:26 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63" returned: 0 in 0.466s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:26 devstack sudo[103051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63
Sep 30 18:04:26 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:26 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62" returned: 0 in 0.779s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:26 devstack sudo[103054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e
Sep 30 18:04:26 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:26 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63" returned: 1 in 0.541s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_vfhost63' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba65c85c-0ee3-48cb-b9e6-69aaf32659b2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:26 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD
Sep 30 18:04:26 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:26 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e" returned: 0 in 0.445s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:26 devstack sudo[103064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e
Sep 30 18:04:26 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:27 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] 90139efc-54c0-4670-ab72-2da0af285eb6 was qcow2, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:27 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57
Sep 30 18:04:27 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:27 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62.8051826f-1de4-4c15-a584-7615ef503e2e" returned: 0 in 0.366s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-8051826f-1de4-4c15-a584-7615ef503e2e" released by "_delete_snapshot" :: held 2.250s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-10b6595e-be4a-4807-926f-61536286ac62" released by "delete_snapshot" :: held 2.293s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Created reservations ['29d56169-d4c8-404a-b8ec-08c248cb410f', 'ce4380ef-a22d-44d3-a5c9-365e6aa99cfd', '0f6dd42b-8fac-4ef2-a5b8-248fe6741223', 'c287a7ab-f5f6-47e3-9346-07f0451651f5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Delete snapshot completed successfully.
Sep 30 18:04:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-04308f68-a7aa-4fe1-910d-328c5d579f5c tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-8051826f-1de4-4c15-a584-7615ef503e2e-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-10b6595e-be4a-4807-926f-61536286ac62-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-10b6595e-be4a-4807-926f-61536286ac62-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-quobyte-10b6595e-be4a-4807-926f-61536286ac62" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-10b6595e-be4a-4807-926f-61536286ac62" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d89e5c-372c-4a65-9eb8-fa561caa0662]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:28 devstack sudo[103086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62
Sep 30 18:04:28 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:28 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62" returned: 0 in 0.534s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:28 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62
Sep 30 18:04:28 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:29 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-10b6595e-be4a-4807-926f-61536286ac62" returned: 0 in 0.316s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-10b6595e-be4a-4807-926f-61536286ac62" released by "delete_volume" :: held 0.940s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Created reservations ['b0357901-ccef-4013-bb32-f1f18e858a9a', '1cf21f5c-4adf-4288-9acf-8f7bb50b33bc', '73f278fa-5bfe-40ce-a700-758f593aced4', '5290eee0-1482-4b09-a280-87b433625d0c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:29 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:29 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:29 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57" returned: 0 in 2.534s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_pgdvc56bdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:04:29 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Converted 112.00 MB image at 44.17 MB/s
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:29 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 1G
Sep 30 18:04:29 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:29 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.304s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Deleted volume successfully.
Sep 30 18:04:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fa63e77e-8a56-4c58-b263-f9e98edea487 tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-10b6595e-be4a-4807-926f-61536286ac62-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:30 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 1G" returned: 0 in 0.402s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Downloaded image 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume 6fc06a77-56f9-4198-81ba-9034e62edf57 successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 for user f88dfca4844149068fceaac42216700c is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Marking volume 6fc06a77-56f9-4198-81ba-9034e62edf57 as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Copying metadata from image 90139efc-54c0-4670-ab72-2da0af285eb6 to 6fc06a77-56f9-4198-81ba-9034e62edf57. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Creating volume glance metadata for volume 6fc06a77-56f9-4198-81ba-9034e62edf57 backed by image 90139efc-54c0-4670-ab72-2da0af285eb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad6090f-2d0c-45f1-9552-ddd55c051694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc06a77-56f9-4198-81ba-9034e62edf57', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f204d10>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2392bc5-46d3-4627-92d5-0f5998c31ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:30 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Volume volume-6fc06a77-56f9-4198-81ba-9034e62edf57 (6fc06a77-56f9-4198-81ba-9034e62edf57): created successfully
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2392bc5-46d3-4627-92d5-0f5998c31ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Flow 'volume_create_manager' (d6308913-47bb-4b74-828f-7f982b094a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f51daf2e-7cce-4bee-9bd8-71fc7bf45f33 tempest-VolumesExtendTest-1766358825 None] Created volume successfully.
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-0d76d633-8bbb-4388-962d-2aade64cef9b-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-0d76d633-8bbb-4388-962d-2aade64cef9b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "cinder-quobyte-0d76d633-8bbb-4388-962d-2aade64cef9b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-0d76d633-8bbb-4388-962d-2aade64cef9b" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75520be-e6d0-41e4-a5ad-a1407c9aef2d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:30 devstack sudo[103105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b
Sep 30 18:04:30 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:31 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b" returned: 0 in 0.455s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:31 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b
Sep 30 18:04:31 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e633b-bb67-4772-a738-04f7375490d1]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:31 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57
Sep 30 18:04:31 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:31 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0d76d633-8bbb-4388-962d-2aade64cef9b" returned: 0 in 0.343s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-quobyte-0d76d633-8bbb-4388-962d-2aade64cef9b" released by "delete_volume" :: held 0.864s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Created reservations ['ef48bbdb-284b-479f-bd48-0cf7f9f94b6c', '5b8345dc-beec-4443-a249-bd47e5a48feb', '47c6d58a-4fbd-4cad-94f1-35848acbd358', '4e432de4-591d-474a-9c4d-489377263787'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:31 devstack sudo[103116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:31 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:31 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57" returned: 0 in 0.539s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 2G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:31 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.370s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 2G" returned: 0 in 0.192s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.772s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Deleted volume successfully.
Sep 30 18:04:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-224289e7-fd01-41cd-92b4-e02701d4d5ed tempest-VolumesExtendTest-1766358825 None] Extend volume completed successfully.
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b58d23ca-2acd-4e92-bce8-16b6d5e2c09b tempest-VolumeDependencyTests-1915415519 None] Lock "cinder-0d76d633-8bbb-4388-962d-2aade64cef9b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-6fc06a77-56f9-4198-81ba-9034e62edf57-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-6fc06a77-56f9-4198-81ba-9034e62edf57-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-quobyte-6fc06a77-56f9-4198-81ba-9034e62edf57" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-6fc06a77-56f9-4198-81ba-9034e62edf57" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[033c6028-1cf5-4778-bc21-e12172381932]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:33 devstack sudo[103127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57
Sep 30 18:04:33 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:33 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57" returned: 0 in 0.425s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:33 devstack sudo[103132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57
Sep 30 18:04:33 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:33 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6fc06a77-56f9-4198-81ba-9034e62edf57" returned: 0 in 0.287s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-6fc06a77-56f9-4198-81ba-9034e62edf57" released by "delete_volume" :: held 0.768s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Created reservations ['9f511cf1-bd00-4e9a-9fec-35d7505ad702', 'c3f3a454-db2b-426b-93c3-5dba8c33245d', '9c59d275-f47b-4cf1-80e1-049cd9b26754', '832b8974-85a0-4988-954f-1964bdb284db'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:33 devstack sudo[103135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:33 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:34 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.336s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Deleted volume successfully.
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1e1463b8-e651-4054-a926-6892f8f4deb6 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-6fc06a77-56f9-4198-81ba-9034e62edf57-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Flow 'volume_create_manager' (250f779a-0513-4c87-9560-9ed2cd5cdbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0716e2-dcab-4c61-b0a8-6bc072dae214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0716e2-dcab-4c61-b0a8-6bc072dae214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1173530826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6924f5-c2ec-486c-a4ea-f8b637b42688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9fa748457c45db97939546c0a92356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:35Z,use_quota=True,user_id='f88dfca4844149068fceaac42216700c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ebb554-d5ff-40ff-a40c-7ab10cf03c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ebb554-d5ff-40ff-a40c-7ab10cf03c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7999a977-077b-446e-8780-3f0e8586d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7999a977-077b-446e-8780-3f0e8586d91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6924f5-c2ec-486c-a4ea-f8b637b42688', 'volume_name': 'volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251632c6-0bf6-474d-a893-38dde0ba0dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251632c6-0bf6-474d-a893-38dde0ba0dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d458740a-4169-40fe-becc-873bf71676fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Volume 4b6924f5-c2ec-486c-a4ea-f8b637b42688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688', 'volume_size': 1}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1173530826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6924f5-c2ec-486c-a4ea-f8b637b42688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9fa748457c45db97939546c0a92356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:35Z,use_quota=True,user_id='f88dfca4844149068fceaac42216700c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Creating volume 4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:34 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:34 devstack sudo[103138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 1073741824
Sep 30 18:04:34 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:35 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 1073741824" returned: 0 in 0.550s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:35 devstack sudo[103144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688
Sep 30 18:04:35 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:35 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688" returned: 0 in 0.406s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d458740a-4169-40fe-becc-873bf71676fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33cd520-b864-44f6-80de-045da3bc0459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Volume volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 (4b6924f5-c2ec-486c-a4ea-f8b637b42688): created successfully
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33cd520-b864-44f6-80de-045da3bc0459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Flow 'volume_create_manager' (250f779a-0513-4c87-9560-9ed2cd5cdbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6aee8a71-6ae5-4de6-a6b0-ad94c36974b5 tempest-VolumesExtendTest-1766358825 None] Created volume successfully.
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Flow 'volume_create_manager' (2f4989b8-4c4c-4e4a-892c-06e935603023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57f35ad-83e6-427b-b617-a31a13c23314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57f35ad-83e6-427b-b617-a31a13c23314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-635011177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff324d16-e0c2-4379-a0d3-c4da0a407eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487c79e0436e4183b0b76c11faee52e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:37Z,use_quota=True,user_id='4962852c83414acabf6749a421709656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1556a723-7c4f-4275-97b8-1d014fc0bcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1556a723-7c4f-4275-97b8-1d014fc0bcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3208dd-08cc-47ec-8da5-4e85fb07e7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3208dd-08cc-47ec-8da5-4e85fb07e7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff324d16-e0c2-4379-a0d3-c4da0a407eca', 'volume_name': 'volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3106b9-d4d2-45f0-ae99-39cbe4d766c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3106b9-d4d2-45f0-ae99-39cbe4d766c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bae187-fe9d-4686-8a22-8516281da98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:36 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Volume ff324d16-e0c2-4379-a0d3-c4da0a407eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca', 'volume_size': 1}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-635011177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff324d16-e0c2-4379-a0d3-c4da0a407eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487c79e0436e4183b0b76c11faee52e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:37Z,use_quota=True,user_id='4962852c83414acabf6749a421709656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Creating volume ff324d16-e0c2-4379-a0d3-c4da0a407eca {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:36 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:36 devstack sudo[103148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca 1073741824
Sep 30 18:04:36 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Flow 'volume_create_manager' (13801bb8-12f6-495f-9650-053426aa542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfabadd-4d73-45f1-ae2b-2c96358897e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfabadd-4d73-45f1-ae2b-2c96358897e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2010946462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646783e8-2615-40f5-8c56-91c2e53a73a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487c79e0436e4183b0b76c11faee52e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:37Z,use_quota=True,user_id='4962852c83414acabf6749a421709656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed420d0-4ea4-4310-9e62-8b3a08c0033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed420d0-4ea4-4310-9e62-8b3a08c0033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962eadbc-8dae-4df0-bb8e-f316922f2dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962eadbc-8dae-4df0-bb8e-f316922f2dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646783e8-2615-40f5-8c56-91c2e53a73a6', 'volume_name': 'volume-646783e8-2615-40f5-8c56-91c2e53a73a6', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abf86f5-af26-4264-b199-de991b9ce33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abf86f5-af26-4264-b199-de991b9ce33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d4dc6a-e7f4-472c-bb0b-a237bc788805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:37 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Volume 646783e8-2615-40f5-8c56-91c2e53a73a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646783e8-2615-40f5-8c56-91c2e53a73a6', 'volume_size': 1}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:37 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca 1073741824" returned: 0 in 0.804s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:37 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca
Sep 30 18:04:37 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:38 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca" returned: 0 in 0.282s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.621s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Creating offline snapshot 6b10ffc1-f049-4a0f-ac00-1715971368fb of volume 4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bae187-fe9d-4686-8a22-8516281da98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bdba42-85dc-4c86-8668-e3e3d371ea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e012d2f8-055d-46df-a889-dea98df78c13]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:38 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Volume volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca (ff324d16-e0c2-4379-a0d3-c4da0a407eca): created successfully
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bdba42-85dc-4c86-8668-e3e3d371ea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Flow 'volume_create_manager' (2f4989b8-4c4c-4e4a-892c-06e935603023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-484c40fd-625a-4724-845e-67612a53af15 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Created volume successfully.
Sep 30 18:04:38 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688
Sep 30 18:04:38 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:38 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688" returned: 0 in 0.508s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:38 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb 1G
Sep 30 18:04:38 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:39 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb 1G" returned: 0 in 0.558s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:39 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb
Sep 30 18:04:39 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:39 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb" returned: 0 in 0.429s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:39 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb is being set with open permissions: ugo+rw
Sep 30 18:04:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:39 devstack sudo[103172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb
Sep 30 18:04:39 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:39 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb" returned: 0 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:40 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info
Sep 30 18:04:40 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:40 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info" returned: 0 in 0.393s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:40 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info is being set with open permissions: ugo+rw
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:40 devstack sudo[103178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info
Sep 30 18:04:40 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:40 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.info" returned: 0 in 0.324s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.250s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2010946462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646783e8-2615-40f5-8c56-91c2e53a73a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487c79e0436e4183b0b76c11faee52e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:37Z,use_quota=True,user_id='4962852c83414acabf6749a421709656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Creating volume 646783e8-2615-40f5-8c56-91c2e53a73a6 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:40 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:40 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6 1073741824
Sep 30 18:04:40 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-70ea2e53-fb68-4751-82f7-9f95d0cb8c64 tempest-VolumesExtendTest-1766358825 None] Create snapshot completed successfully
Sep 30 18:04:40 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:41 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6 1073741824" returned: 0 in 0.646s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:41 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6
Sep 30 18:04:41 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:41 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.279s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d4dc6a-e7f4-472c-bb0b-a237bc788805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646783e8-2615-40f5-8c56-91c2e53a73a6', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68453ac9-ce1c-4956-95f9-bce2799162e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea2cd4a-f48f-4988-b318-970c0141321e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:41 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Volume volume-646783e8-2615-40f5-8c56-91c2e53a73a6 (646783e8-2615-40f5-8c56-91c2e53a73a6): created successfully
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68453ac9-ce1c-4956-95f9-bce2799162e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Flow 'volume_create_manager' (13801bb8-12f6-495f-9650-053426aa542f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ea412d8e-6d27-4260-8ce6-8777a1927618 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Created volume successfully.
Sep 30 18:04:42 devstack sudo[103200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688
Sep 30 18:04:42 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:42 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688" returned: 0 in 0.625s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb 2G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb 2G" returned: 0 in 0.235s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.962s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6daa81bd-8b0c-426e-9ccd-4733d319235b tempest-VolumesExtendTest-1766358825 None] Extend volume completed successfully.
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Flow 'volume_create_manager' (79b1402b-e6d0-41ac-8d7c-f2eb90d0b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3763b0d1-43f0-4830-9da0-ef41c5891804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3763b0d1-43f0-4830-9da0-ef41c5891804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84c4120-4db5-434b-9ff4-34060f73f966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e342a6bef59429f8733cc5402f2152c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:43Z,use_quota=True,user_id='a72b259f4bc847a9aa28f51344b02424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ab81e3-6ced-4aff-99c9-08deef7f9c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ab81e3-6ced-4aff-99c9-08deef7f9c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0483ad-47d6-492d-b047-04e6f64592d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0483ad-47d6-492d-b047-04e6f64592d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd84c4120-4db5-434b-9ff4-34060f73f966', 'volume_name': 'volume-d84c4120-4db5-434b-9ff4-34060f73f966', 'volume_size': 1, 'image_id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/852c940d-7987-44e6-86f1-58c27310ddd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7075984144cfde5df627a7ca299263a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e342a6bef59429f8733cc5402f2152c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4539108762b16e1bd0f318b64dea1ff942c021ee58b367639dc0de54c1c539f21fffd3ae0907f9091b6c6216094bb24d980203900fa72d8d7386a417797a34e', 'id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'created_at': datetime.datetime(2026, 9, 30, 16, 4, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/852c940d-7987-44e6-86f1-58c27310ddd8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f43aff0>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6337554c-c07a-4b34-9373-01f97f7873c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6337554c-c07a-4b34-9373-01f97f7873c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e2b049-d350-4cc6-9382-5ef92d067b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:43 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Volume d84c4120-4db5-434b-9ff4-34060f73f966: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d84c4120-4db5-434b-9ff4-34060f73f966', 'volume_size': 1, 'image_id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/852c940d-7987-44e6-86f1-58c27310ddd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7075984144cfde5df627a7ca299263a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e342a6bef59429f8733cc5402f2152c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4539108762b16e1bd0f318b64dea1ff942c021ee58b367639dc0de54c1c539f21fffd3ae0907f9091b6c6216094bb24d980203900fa72d8d7386a417797a34e', 'id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'created_at': datetime.datetime(2026, 9, 30, 16, 4, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/852c940d-7987-44e6-86f1-58c27310ddd8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f43aff0>}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Trying to clone d84c4120-4db5-434b-9ff4-34060f73f966 from image 852c940d-7987-44e6-86f1-58c27310ddd8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/852c940d-7987-44e6-86f1-58c27310ddd8', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:04:43 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f8695-99ae-4b8f-8a0e-b3ad2856ba65]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:44 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD
Sep 30 18:04:44 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-6b10ffc1-f049-4a0f-ac00-1715971368fb-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Lock "cinder-6b10ffc1-f049-4a0f-ac00-1715971368fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-quobyte-4b6924f5-c2ec-486c-a4ea-f8b637b42688" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-4b6924f5-c2ec-486c-a4ea-f8b637b42688" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-quobyte-6b10ffc1-f049-4a0f-ac00-1715971368fb" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-6b10ffc1-f049-4a0f-ac00-1715971368fb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Deleting offline snapshot 6b10ffc1-f049-4a0f-ac00-1715971368fb of volume 4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] snapshot_file for this snap is: volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868333f-8172-4726-818e-0b3d09522a59]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:44 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:44 devstack sudo[103228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb
Sep 30 18:04:44 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:44 devstack sudo[103231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD
Sep 30 18:04:44 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:44 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb" returned: 0 in 0.492s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:04:44 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Temporary image 852c940d-7987-44e6-86f1-58c27310ddd8 is fetched for user a72b259f4bc847a9aa28f51344b02424. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc0bc5f-4cfe-47c0-967d-21c20e98d4fa]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c7d0b2-3959-4e77-a5d6-93cb21c36988]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:44 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688
Sep 30 18:04:44 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:44 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD
Sep 30 18:04:44 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:45 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:45 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688" returned: 0 in 0.584s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:45 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb
Sep 30 18:04:45 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:45 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD
Sep 30 18:04:45 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:45 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84c4120-4db5-434b-9ff4-34060f73f966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e342a6bef59429f8733cc5402f2152c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:43Z,use_quota=True,user_id='a72b259f4bc847a9aa28f51344b02424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Creating volume d84c4120-4db5-434b-9ff4-34060f73f966 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:45 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:45 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 1073741824
Sep 30 18:04:45 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:46 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb" returned: 0 in 0.719s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:04:46 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb
Sep 30 18:04:46 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Flow 'volume_create_manager' (e7097ee6-d777-4f88-b4b6-ad04315e8df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69919a2a-9453-4e16-bac5-73923d04dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69919a2a-9453-4e16-bac5-73923d04dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199787269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3548e279-8c14-4114-bed3-b3a6ded783aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa4c52d20584ae898009f48bfb8ada2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:46Z,use_quota=True,user_id='f897c25f9e4d4e7ca7a5c28b99854eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1515d95d-d7ef-4f5d-8781-9689acda115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1515d95d-d7ef-4f5d-8781-9689acda115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb465f1-e8be-42b7-8382-9493099f9e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb465f1-e8be-42b7-8382-9493099f9e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3548e279-8c14-4114-bed3-b3a6ded783aa', 'volume_name': 'volume-3548e279-8c14-4114-bed3-b3a6ded783aa', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad88375e-c981-42d2-be82-580bedba232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad88375e-c981-42d2-be82-580bedba232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60824d51-1468-4433-b686-479d97271658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:46 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Volume 3548e279-8c14-4114-bed3-b3a6ded783aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3548e279-8c14-4114-bed3-b3a6ded783aa', 'volume_size': 1}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:04:46 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688.6b10ffc1-f049-4a0f-ac00-1715971368fb" returned: 0 in 0.591s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-6b10ffc1-f049-4a0f-ac00-1715971368fb" released by "_delete_snapshot" :: held 2.558s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-4b6924f5-c2ec-486c-a4ea-f8b637b42688" released by "delete_snapshot" :: held 2.599s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:46 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 1073741824" returned: 0 in 1.107s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:46 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Created reservations ['767f2d6a-42b0-409f-8610-7ba9001d5f95', 'f16e33af-2c34-4f4e-8497-ef208240922a', 'a6ad85ca-b712-42b3-963d-86555bcac32c', 'f439dd03-8f10-4c9b-ba85-8ecc662b4141'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:46 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966
Sep 30 18:04:46 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Delete snapshot completed successfully.
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d8ab2a44-60f4-4a98-a11c-3d45650f41bd tempest-VolumesExtendTest-1766358825 None] Lock "cinder-6b10ffc1-f049-4a0f-ac00-1715971368fb-delete_snapshot" released by "delete_snapshot" :: held 2.949s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:47 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966" returned: 0 in 0.446s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199787269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3548e279-8c14-4114-bed3-b3a6ded783aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa4c52d20584ae898009f48bfb8ada2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:04:46Z,use_quota=True,user_id='f897c25f9e4d4e7ca7a5c28b99854eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Creating volume 3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:04:47 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:47 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa 1073741824
Sep 30 18:04:47 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Attempting download of 852c940d-7987-44e6-86f1-58c27310ddd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/852c940d-7987-44e6-86f1-58c27310ddd8', 'metadata': {}}])) to volume d84c4120-4db5-434b-9ff4-34060f73f966. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a2e67-4d40-43a6-98ef-df2dd7ffe2f3]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-4b6924f5-c2ec-486c-a4ea-f8b637b42688-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-4b6924f5-c2ec-486c-a4ea-f8b637b42688-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:47 devstack sudo[103343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90
Sep 30 18:04:47 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "cinder-quobyte-4b6924f5-c2ec-486c-a4ea-f8b637b42688" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-4b6924f5-c2ec-486c-a4ea-f8b637b42688" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd2125f-b640-464f-8d3b-b321d1879864]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:48 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688
Sep 30 18:04:48 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:48 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90" returned: 0 in 0.488s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:48 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa 1073741824" returned: 0 in 0.774s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:48 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90
Sep 30 18:04:48 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:48 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:04:48 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:48 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90" returned: 1 in 0.485s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_852c940d-7987-44e6-86f1-58c27310ddd8_bcnhrv90' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:04:48 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf6eaae-890d-4990-831f-dc5d8581bd27]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688" returned: 0 in 0.774s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:48 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688
Sep 30 18:04:48 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:48 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.507s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60824d51-1468-4433-b686-479d97271658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3548e279-8c14-4114-bed3-b3a6ded783aa', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:48 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b7754b-d02f-4d4e-877c-22581b38ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:48 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Volume volume-3548e279-8c14-4114-bed3-b3a6ded783aa (3548e279-8c14-4114-bed3-b3a6ded783aa): created successfully
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b7754b-d02f-4d4e-877c-22581b38ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Flow 'volume_create_manager' (e7097ee6-d777-4f88-b4b6-ad04315e8df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7ababe01-696f-4fca-8660-5e33368dcfc7 tempest-VolumesActionsTest-1260703015 None] Created volume successfully.
Sep 30 18:04:49 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b6924f5-c2ec-486c-a4ea-f8b637b42688" returned: 0 in 0.507s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-quobyte-4b6924f5-c2ec-486c-a4ea-f8b637b42688" released by "delete_volume" :: held 1.387s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:49 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Created reservations ['b168b22a-af59-46ee-92b7-038f6113a0a1', 'e4677446-d13e-4fdf-a2c1-675fd44b1aa1', '5dd5a3f3-49a8-41b2-94e2-c6fb0dae7501', '45f8cb94-bd7d-400c-ac4f-c248c96d0840'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:49 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:49 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:49 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:49 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:49 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD" returned: 1 in 0.455s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] 852c940d-7987-44e6-86f1-58c27310ddd8 was raw, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:49 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966
Sep 30 18:04:49 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:49 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.413s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:49 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Deleted volume successfully.
Sep 30 18:04:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c037d80f-8639-4f52-99db-ca99bbbf9693 tempest-VolumesExtendTest-1766358825 None] Lock "cinder-4b6924f5-c2ec-486c-a4ea-f8b637b42688-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:50 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966" returned: 0 in 0.594s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_852c940d-7987-44e6-86f1-58c27310ddd8_8osh6wacdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:04:50 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:50 devstack sudo[103436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 1G
Sep 30 18:04:50 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:50 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 1G" returned: 0 in 0.393s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Downloaded image 852c940d-7987-44e6-86f1-58c27310ddd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/852c940d-7987-44e6-86f1-58c27310ddd8', 'metadata': {}}])) to volume d84c4120-4db5-434b-9ff4-34060f73f966 successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Temporary image 852c940d-7987-44e6-86f1-58c27310ddd8 for user a72b259f4bc847a9aa28f51344b02424 is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Marking volume d84c4120-4db5-434b-9ff4-34060f73f966 as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Copying metadata from image 852c940d-7987-44e6-86f1-58c27310ddd8 to d84c4120-4db5-434b-9ff4-34060f73f966. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Creating volume glance metadata for volume d84c4120-4db5-434b-9ff4-34060f73f966 backed by image 852c940d-7987-44e6-86f1-58c27310ddd8 with: {'image_id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c7075984144cfde5df627a7ca299263a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e2b049-d350-4cc6-9382-5ef92d067b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84c4120-4db5-434b-9ff4-34060f73f966', 'volume_size': 1, 'image_id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/852c940d-7987-44e6-86f1-58c27310ddd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7075984144cfde5df627a7ca299263a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e342a6bef59429f8733cc5402f2152c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4539108762b16e1bd0f318b64dea1ff942c021ee58b367639dc0de54c1c539f21fffd3ae0907f9091b6c6216094bb24d980203900fa72d8d7386a417797a34e', 'id': '852c940d-7987-44e6-86f1-58c27310ddd8', 'created_at': datetime.datetime(2026, 9, 30, 16, 4, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/852c940d-7987-44e6-86f1-58c27310ddd8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f43aff0>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c32410b-96bb-4e62-b808-523299709cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:04:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Volume volume-d84c4120-4db5-434b-9ff4-34060f73f966 (d84c4120-4db5-434b-9ff4-34060f73f966): created successfully
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c32410b-96bb-4e62-b808-523299709cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:04:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Flow 'volume_create_manager' (79b1402b-e6d0-41ac-8d7c-f2eb90d0b17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:04:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a98d9286-f7b8-45a3-8760-e8cc67ba8f7a tempest-VolumeImageDependencyTests-1342144866 None] Created volume successfully.
Sep 30 18:04:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Acquiring lock "cinder-d84c4120-4db5-434b-9ff4-34060f73f966-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Lock "cinder-d84c4120-4db5-434b-9ff4-34060f73f966-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Acquiring lock "cinder-quobyte-d84c4120-4db5-434b-9ff4-34060f73f966" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:04:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Lock "cinder-quobyte-d84c4120-4db5-434b-9ff4-34060f73f966" acquired by "delete_volume" :: waited 0.052s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:04:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c835e-4821-4dc4-9525-7e679d90030a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:04:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:52 devstack sudo[103446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966
Sep 30 18:04:52 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:53 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966" returned: 0 in 1.090s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:53 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966
Sep 30 18:04:53 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:53 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d84c4120-4db5-434b-9ff4-34060f73f966" returned: 0 in 0.579s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Lock "cinder-quobyte-d84c4120-4db5-434b-9ff4-34060f73f966" released by "delete_volume" :: held 1.759s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Created reservations ['7074e17a-de3e-4ce4-9e88-3fa15bdcb7b8', '8a617cee-d939-48c2-bc44-a21c0c4d01d7', '1e84207e-c3d9-433c-96ef-36f2c3626a99', '7a4d0de5-483d-4971-b3c9-c5052abbe05a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:04:54 devstack sudo[103471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:04:54 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:04:54 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.490s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:04:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Deleted volume successfully.
Sep 30 18:04:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-de22f87e-aa5a-4dcd-b4a9-952841f875c1 tempest-VolumeImageDependencyTests-1342144866 None] Lock "cinder-d84c4120-4db5-434b-9ff4-34060f73f966-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e3e74711-2a68-4912-89ca-762934d08355 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa" by "attach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e3e74711-2a68-4912-89ca-762934d08355 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa" acquired by "attach_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e3e74711-2a68-4912-89ca-762934d08355 tempest-VolumesActionsTest-1260703015 None] Attaching volume 3548e279-8c14-4114-bed3-b3a6ded783aa to instance 537debf7-0bb1-49a7-b7a8-5e1dce00070b at mountpoint /dev/vdb on host None.
Sep 30 18:05:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e3e74711-2a68-4912-89ca-762934d08355 tempest-VolumesActionsTest-1260703015 None] Attach volume completed successfully.
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e3e74711-2a68-4912-89ca-762934d08355 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa" released by "attach_volume" :: held 0.171s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Flow 'volume_create_manager' (a06b1be8-bd99-42c2-8e05-c26a9514e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2f2779-3d19-4e38-8337-8bd6bb904262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2f2779-3d19-4e38-8337-8bd6bb904262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118225953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70225fc1-53a1-4938-852b-27c5e75ed5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca5030140b64d4e9f8b0cf4387e4e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:02Z,use_quota=True,user_id='563acf61bea641db90d19ae6e83a97ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a278f997-79f0-4f63-bdc1-a45e8e23ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a278f997-79f0-4f63-bdc1-a45e8e23ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962c95e5-1fd6-492e-941a-6791858bfa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962c95e5-1fd6-492e-941a-6791858bfa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70225fc1-53a1-4938-852b-27c5e75ed5f7', 'volume_name': 'volume-70225fc1-53a1-4938-852b-27c5e75ed5f7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe94bfd-80a2-458f-99d5-863eb39e05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe94bfd-80a2-458f-99d5-863eb39e05ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6aef26a-4617-4eb4-8bb6-51fbf674ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:02 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Volume 70225fc1-53a1-4938-852b-27c5e75ed5f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70225fc1-53a1-4938-852b-27c5e75ed5f7', 'volume_size': 1}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118225953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70225fc1-53a1-4938-852b-27c5e75ed5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca5030140b64d4e9f8b0cf4387e4e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:02Z,use_quota=True,user_id='563acf61bea641db90d19ae6e83a97ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Creating volume 70225fc1-53a1-4938-852b-27c5e75ed5f7 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:05:02 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f7a0ed09-a2a8-4974-883a-7e9a5f65b0f7 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-detach_volume" by "detach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:02 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 1073741824
Sep 30 18:05:02 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f7a0ed09-a2a8-4974-883a-7e9a5f65b0f7 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f7a0ed09-a2a8-4974-883a-7e9a5f65b0f7 tempest-VolumesActionsTest-1260703015 None] Detaching volume 3548e279-8c14-4114-bed3-b3a6ded783aa from instance 537debf7-0bb1-49a7-b7a8-5e1dce00070b.
Sep 30 18:05:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f7a0ed09-a2a8-4974-883a-7e9a5f65b0f7 tempest-VolumesActionsTest-1260703015 None] Detach volume completed successfully.
Sep 30 18:05:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f7a0ed09-a2a8-4974-883a-7e9a5f65b0f7 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-detach_volume" released by "detach_volume" :: held 0.130s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:03 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 1073741824" returned: 0 in 1.020s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:03 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7
Sep 30 18:05:03 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:04 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7" returned: 0 in 0.490s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6aef26a-4617-4eb4-8bb6-51fbf674ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70225fc1-53a1-4938-852b-27c5e75ed5f7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af42d2f-fd9a-4012-8b5e-713ad74c2092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:04 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Volume volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 (70225fc1-53a1-4938-852b-27c5e75ed5f7): created successfully
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af42d2f-fd9a-4012-8b5e-713ad74c2092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Flow 'volume_create_manager' (a06b1be8-bd99-42c2-8e05-c26a9514e12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:05:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b437a4bb-33cb-4dbe-9968-dce244f784a0 tempest-ProjectReaderTests-1304046386 None] Created volume successfully.
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Acquiring lock "cinder-70225fc1-53a1-4938-852b-27c5e75ed5f7-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Lock "cinder-70225fc1-53a1-4938-852b-27c5e75ed5f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=106,cinder:UPDATE=114,cinder:INSERT=35,cinder:DELETE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:05:04 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=93,cinder:UPDATE=115,cinder:INSERT=38,cinder:DELETE=16 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Acquiring lock "cinder-quobyte-70225fc1-53a1-4938-852b-27c5e75ed5f7" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Lock "cinder-quobyte-70225fc1-53a1-4938-852b-27c5e75ed5f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6fc101-9363-4d3b-85aa-a4c5912fd836]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:05 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7
Sep 30 18:05:05 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:05 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7" returned: 0 in 0.418s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:05 devstack sudo[103621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7
Sep 30 18:05:05 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:05 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-70225fc1-53a1-4938-852b-27c5e75ed5f7" returned: 0 in 0.320s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Lock "cinder-quobyte-70225fc1-53a1-4938-852b-27c5e75ed5f7" released by "delete_volume" :: held 0.824s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:05 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Created reservations ['b8d8ade9-e402-417a-bcf5-6e6172142638', '08ab1ef0-6ee2-4b04-8e4b-05fa3b32e7b0', '25f6dd3e-a089-4fb9-a3f7-ba81f2a0c659', '0a524706-98be-4ab3-8a8c-4b1e778561a7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:06 devstack sudo[103626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:05:06 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:06 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.352s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:05:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Deleted volume successfully.
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d0790c6e-b614-4c04-a4d2-94c86366c1b4 tempest-ProjectReaderTests-1304046386 None] Lock "cinder-70225fc1-53a1-4938-852b-27c5e75ed5f7-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Flow 'volume_create_manager' (916d09cc-60c4-4562-be55-3c547ba70285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f90f5c9-77ba-444c-bc19-b589039c6c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f90f5c9-77ba-444c-bc19-b589039c6c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540169321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f66660-7ede-4b5e-9533-23ce58f36c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca5030140b64d4e9f8b0cf4387e4e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:07Z,use_quota=True,user_id='563acf61bea641db90d19ae6e83a97ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81039418-b204-4eeb-8e30-e2329a5b6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81039418-b204-4eeb-8e30-e2329a5b6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0c2ff0-026d-43c8-a598-1cf9468b86c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0c2ff0-026d-43c8-a598-1cf9468b86c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f66660-7ede-4b5e-9533-23ce58f36c88', 'volume_name': 'volume-21f66660-7ede-4b5e-9533-23ce58f36c88', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fbf6b2-f47c-40c9-b511-1de7b2b49681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fbf6b2-f47c-40c9-b511-1de7b2b49681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cfb5d9-b734-413e-9cd1-e557976cfe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Volume 21f66660-7ede-4b5e-9533-23ce58f36c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f66660-7ede-4b5e-9533-23ce58f36c88', 'volume_size': 1}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540169321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f66660-7ede-4b5e-9533-23ce58f36c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca5030140b64d4e9f8b0cf4387e4e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:07Z,use_quota=True,user_id='563acf61bea641db90d19ae6e83a97ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Creating volume 21f66660-7ede-4b5e-9533-23ce58f36c88 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:05:06 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:05:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:06 devstack sudo[103630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88 1073741824
Sep 30 18:05:06 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:07 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88 1073741824" returned: 0 in 0.523s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:07 devstack sudo[103636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88
Sep 30 18:05:07 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:07 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cfb5d9-b734-413e-9cd1-e557976cfe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f66660-7ede-4b5e-9533-23ce58f36c88', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174f2c4d-a4a3-4280-9b4f-b88546c98679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:07 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Volume volume-21f66660-7ede-4b5e-9533-23ce58f36c88 (21f66660-7ede-4b5e-9533-23ce58f36c88): created successfully
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174f2c4d-a4a3-4280-9b4f-b88546c98679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Flow 'volume_create_manager' (916d09cc-60c4-4562-be55-3c547ba70285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:05:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7e1ebd6b-3835-4eee-9c1b-35114c11ec0c tempest-ProjectReaderTests-1304046386 None] Created volume successfully.
Sep 30 18:05:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Acquiring lock "cinder-21f66660-7ede-4b5e-9533-23ce58f36c88-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Lock "cinder-21f66660-7ede-4b5e-9533-23ce58f36c88-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Acquiring lock "cinder-quobyte-21f66660-7ede-4b5e-9533-23ce58f36c88" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Lock "cinder-quobyte-21f66660-7ede-4b5e-9533-23ce58f36c88" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3dc328-1b36-4388-b805-9d0622814b91]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:09 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88
Sep 30 18:05:09 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:09 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88" returned: 0 in 0.569s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:09 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88
Sep 30 18:05:09 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:10 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21f66660-7ede-4b5e-9533-23ce58f36c88" returned: 0 in 0.458s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Lock "cinder-quobyte-21f66660-7ede-4b5e-9533-23ce58f36c88" released by "delete_volume" :: held 1.134s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Created reservations ['502a8261-9eda-4ddf-b6c4-b132909ead17', '624afb30-86bc-4706-b2b6-140f04e71db6', '1c3d819d-bf2d-472f-a63b-e5719745bae7', '3abc513d-8892-49fb-b000-1d8634c4e4d4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:10 devstack sudo[103669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:05:10 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:10 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.272s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:05:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Deleted volume successfully.
Sep 30 18:05:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1a7346fd-cb73-459b-83de-477218b0f3dd tempest-ProjectReaderTests-1304046386 None] Lock "cinder-21f66660-7ede-4b5e-9533-23ce58f36c88-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-47cc2997-d5c2-414d-8b04-68c381259031 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa" by "attach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-47cc2997-d5c2-414d-8b04-68c381259031 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa" acquired by "attach_volume" :: waited 0.037s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ada88ace-3e57-4dd3-b29d-74da9035250a req-6ecc4928-ec37-43c6-bff1-794e27eabaa6 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ada88ace-3e57-4dd3-b29d-74da9035250a req-6ecc4928-ec37-43c6-bff1-794e27eabaa6 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ada88ace-3e57-4dd3-b29d-74da9035250a req-6ecc4928-ec37-43c6-bff1-794e27eabaa6 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-47cc2997-d5c2-414d-8b04-68c381259031 tempest-VolumesActionsTest-1260703015 None] Attaching volume 3548e279-8c14-4114-bed3-b3a6ded783aa to instance 849bb0a4-2d96-424d-b83b-b0700643442f at mountpoint /dev/vdb on host None.
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-ada88ace-3e57-4dd3-b29d-74da9035250a req-6ecc4928-ec37-43c6-bff1-794e27eabaa6 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d37fe32-6267-44e0-b292-750d399b8a4b', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:05:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-47cc2997-d5c2-414d-8b04-68c381259031 tempest-VolumesActionsTest-1260703015 None] Attach volume completed successfully.
Sep 30 18:05:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-47cc2997-d5c2-414d-8b04-68c381259031 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa" released by "attach_volume" :: held 0.180s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-ada88ace-3e57-4dd3-b29d-74da9035250a req-6ecc4928-ec37-43c6-bff1-794e27eabaa6 tempest-TestServerVolumeAttachmentScenario-1157873554 None] attachment_update completed successfully.
Sep 30 18:05:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3bc66738-979b-4eec-bf45-5eeeb86483b6 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-detach_volume" by "detach_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3bc66738-979b-4eec-bf45-5eeeb86483b6 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3bc66738-979b-4eec-bf45-5eeeb86483b6 tempest-VolumesActionsTest-1260703015 None] Detaching volume 3548e279-8c14-4114-bed3-b3a6ded783aa from instance 849bb0a4-2d96-424d-b83b-b0700643442f.
Sep 30 18:05:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3bc66738-979b-4eec-bf45-5eeeb86483b6 tempest-VolumesActionsTest-1260703015 None] Detach volume completed successfully.
Sep 30 18:05:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-3bc66738-979b-4eec-bf45-5eeeb86483b6 tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7c70b8d2-fb7d-4c21-a600-145df6ca938c req-92d12c2c-d565-462b-89e1-efa1e98fbc5b tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7c70b8d2-fb7d-4c21-a600-145df6ca938c req-92d12c2c-d565-462b-89e1-efa1e98fbc5b tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-7c70b8d2-fb7d-4c21-a600-145df6ca938c req-92d12c2c-d565-462b-89e1-efa1e98fbc5b tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-7c70b8d2-fb7d-4c21-a600-145df6ca938c req-92d12c2c-d565-462b-89e1-efa1e98fbc5b tempest-TestServerVolumeAttachmentScenario-1157873554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-646783e8-2615-40f5-8c56-91c2e53a73a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37a951f3-223e-46e1-a866-0c37e8d2f45d', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:05:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-7c70b8d2-fb7d-4c21-a600-145df6ca938c req-92d12c2c-d565-462b-89e1-efa1e98fbc5b tempest-TestServerVolumeAttachmentScenario-1157873554 None] attachment_update completed successfully.
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba7143a-d055-4d40-9711-9576280f900a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:26 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:05:26 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:05:26 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (6f17ce38-92fc-4716-948f-bce8cdcab3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d30171-1457-4966-b1be-654d69f7ee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.572s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d30171-1457-4966-b1be-654d69f7ee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717754848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e3c9af-8a67-4c06-a471-3fb980d88a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:27Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de26e66-8a10-490d-b43c-1d3178653f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de26e66-8a10-490d-b43c-1d3178653f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acade6d7-1f0a-4fd8-99b8-6b12c428c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acade6d7-1f0a-4fd8-99b8-6b12c428c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e3c9af-8a67-4c06-a471-3fb980d88a8f', 'volume_name': 'volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025b548e-2067-49e1-b1cd-df93e67d3719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025b548e-2067-49e1-b1cd-df93e67d3719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d1e6e4-0054-43b7-bfed-d77f69f5d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Volume c6e3c9af-8a67-4c06-a471-3fb980d88a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f', 'volume_size': 1}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69b0c98-276b-453b-b492-d6c582fcd8f8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:27 devstack sudo[104237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:05:27 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:27 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.420s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.51728aba-daf5-40a2-8300-5b044aba499f668um61y.img {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:27 devstack sudo[104242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.51728aba-daf5-40a2-8300-5b044aba499f668um61y.img
Sep 30 18:05:27 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-00ed57db-2fad-446a-b7ff-0bd0c242ac8d req-1989923c-a746-4fd4-ae2d-5762e62dcc23 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Terminate volume connection completed successfully.
Sep 30 18:05:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-00ed57db-2fad-446a-b7ff-0bd0c242ac8d req-1989923c-a746-4fd4-ae2d-5762e62dcc23 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Deleting attachment 37a951f3-223e-46e1-a866-0c37e8d2f45d. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:05:32 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-7bedb087-b245-43f3-95a5-fee57905ed7e req-f7ba5074-c9b8-40ff-a77d-c15355ae237b tempest-TestServerVolumeAttachmentScenario-1157873554 None] Terminate volume connection completed successfully.
Sep 30 18:05:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-7bedb087-b245-43f3-95a5-fee57905ed7e req-f7ba5074-c9b8-40ff-a77d-c15355ae237b tempest-TestServerVolumeAttachmentScenario-1157873554 None] Deleting attachment 0d37fe32-6267-44e0-b292-750d399b8a4b. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:05:35 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.51728aba-daf5-40a2-8300-5b044aba499f668um61y.img" returned: 0 in 8.600s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a70d9-9feb-4f27-9abc-41b149b0559c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:36 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:05:36 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:36 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.584s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:36 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa, size 1024.00 MB, duration 8.60 sec, destination /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.51728aba-daf5-40a2-8300-5b044aba499f668um61y.img {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:05:36 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Converted 1024.00 MB image at 119.06 MB/s
Sep 30 18:05:36 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] 51728aba-daf5-40a2-8300-5b044aba499f was raw, no need to convert to raw {{(pid=87418) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 30 18:05:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "cinder-646783e8-2615-40f5-8c56-91c2e53a73a6-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-646783e8-2615-40f5-8c56-91c2e53a73a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "cinder-quobyte-646783e8-2615-40f5-8c56-91c2e53a73a6" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-quobyte-646783e8-2615-40f5-8c56-91c2e53a73a6" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:40 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a466119d-30c8-418e-b131-3c6ebbe451e7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:40 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6
Sep 30 18:05:40 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:41 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6" returned: 0 in 0.609s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:41 devstack sudo[104335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6
Sep 30 18:05:41 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:41 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-646783e8-2615-40f5-8c56-91c2e53a73a6" returned: 0 in 0.520s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-quobyte-646783e8-2615-40f5-8c56-91c2e53a73a6" released by "delete_volume" :: held 1.219s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Created reservations ['556887a1-8891-4aa0-91f5-7d825c12edeb', '60c15604-0957-43b4-8bbc-9247f5191bb5', '258bc6f4-1665-41c9-be1a-a530784acda6', '658006ea-11e6-4fe0-b2ae-2e5de89bf22b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:42 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:05:42 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:42 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:05:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Deleted volume successfully.
Sep 30 18:05:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5c73f5a8-3d95-4f87-be05-713bf2a8f4b8 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-646783e8-2615-40f5-8c56-91c2e53a73a6-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "cinder-ff324d16-e0c2-4379-a0d3-c4da0a407eca-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-ff324d16-e0c2-4379-a0d3-c4da0a407eca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "cinder-quobyte-ff324d16-e0c2-4379-a0d3-c4da0a407eca" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-quobyte-ff324d16-e0c2-4379-a0d3-c4da0a407eca" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc53357-3eb3-4629-8760-6eb59b1d7d2c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:43 devstack sudo[104376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca
Sep 30 18:05:43 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:43 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca" returned: 0 in 0.471s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:43 devstack sudo[104384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca
Sep 30 18:05:43 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:44 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff324d16-e0c2-4379-a0d3-c4da0a407eca" returned: 0 in 0.338s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-quobyte-ff324d16-e0c2-4379-a0d3-c4da0a407eca" released by "delete_volume" :: held 0.895s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Created reservations ['50bbf7cf-19be-45f8-9344-67628166c43c', 'ead31ba2-6553-4dad-932e-205a3c9fe96a', '9f0bd89a-d5c0-43be-93ea-78c0ab158e63', 'eec67293-d8ff-4f67-b358-19f9b5c21448'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:44 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:05:44 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:44 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.356s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:05:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Deleted volume successfully.
Sep 30 18:05:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60f23332-610d-47d1-80f7-1f7110ff43c5 tempest-TestServerVolumeAttachmentScenario-1157873554 None] Lock "cinder-ff324d16-e0c2-4379-a0d3-c4da0a407eca-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:05:46 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:05:46 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:05:46 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.528s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:05:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:05:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:05:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Flow 'volume_create_manager' (07ce059b-6109-4886-84ff-1d6327045054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01994edf-df78-41ec-a6c1-53919a72d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01994edf-df78-41ec-a6c1-53919a72d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-163064519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65f3f56-a04d-4c74-b135-5d606d535345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e443c50e51c45258c89fb6a1fb94fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:51Z,use_quota=True,user_id='3e2bd401e4f348ddae68becb6be66f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eb77dc-9328-476b-8e0d-b0de5249169f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eb77dc-9328-476b-8e0d-b0de5249169f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec8c61b-1a8c-46fa-8da6-b4ca58e39fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec8c61b-1a8c-46fa-8da6-b4ca58e39fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65f3f56-a04d-4c74-b135-5d606d535345', 'volume_name': 'volume-a65f3f56-a04d-4c74-b135-5d606d535345', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9470f0-6158-4df5-b054-bd6eac0df1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9470f0-6158-4df5-b054-bd6eac0df1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6ce1df-9e1e-4f74-a5e7-2ecdca6352d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:05:51 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Volume a65f3f56-a04d-4c74-b135-5d606d535345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65f3f56-a04d-4c74-b135-5d606d535345', 'volume_size': 1}
Sep 30 18:05:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:01 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=44,cinder:INSERT=9,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:06:01 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=49,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.727s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Uploaded volume to glance image-id: 51728aba-daf5-40a2-8300-5b044aba499f. {{(pid=87418) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.050s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717754848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e3c9af-8a67-4c06-a471-3fb980d88a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:27Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Creating volume c6e3c9af-8a67-4c06-a471-3fb980d88a8f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:02 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:02 devstack sudo[104550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f 1073741824
Sep 30 18:06:02 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0e59283b-55c4-47fc-bcb3-d9af995bfc61 tempest-VolumesActionsTest-1260703015 None] Copy volume to image completed successfully.
Sep 30 18:06:03 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f 1073741824" returned: 0 in 0.466s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:03 devstack sudo[104556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f
Sep 30 18:06:03 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:03 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.088s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-163064519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65f3f56-a04d-4c74-b135-5d606d535345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e443c50e51c45258c89fb6a1fb94fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:05:51Z,use_quota=True,user_id='3e2bd401e4f348ddae68becb6be66f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Creating volume a65f3f56-a04d-4c74-b135-5d606d535345 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:03 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:03 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345 1073741824
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d1e6e4-0054-43b7-bfed-d77f69f5d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:03 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb9a40e-d009-48da-b8b4-48d6ac1265b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:03 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Volume volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f (c6e3c9af-8a67-4c06-a471-3fb980d88a8f): created successfully
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb9a40e-d009-48da-b8b4-48d6ac1265b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (6f17ce38-92fc-4716-948f-bce8cdcab3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fa24c893-30d3-4769-82ec-67357afe1381 tempest-ProjectReaderTests-1310888770 None] Created volume successfully.
Sep 30 18:06:04 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345 1073741824" returned: 0 in 0.539s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:04 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345
Sep 30 18:06:04 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:04 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345" returned: 0 in 0.322s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6ce1df-9e1e-4f74-a5e7-2ecdca6352d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65f3f56-a04d-4c74-b135-5d606d535345', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaa87b6-5254-4ccd-9d4c-85c317382724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:04 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Volume volume-a65f3f56-a04d-4c74-b135-5d606d535345 (a65f3f56-a04d-4c74-b135-5d606d535345): created successfully
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaa87b6-5254-4ccd-9d4c-85c317382724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Flow 'volume_create_manager' (07ce059b-6109-4886-84ff-1d6327045054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ec139cf0-614f-4d85-8047-767b93b71a36 tempest-TestMinimumBasicScenario-730232333 None] Created volume successfully.
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b63fb30-6202-446c-ad42-afefade67304]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-c6e3c9af-8a67-4c06-a471-3fb980d88a8f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-c6e3c9af-8a67-4c06-a471-3fb980d88a8f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-quobyte-c6e3c9af-8a67-4c06-a471-3fb980d88a8f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-c6e3c9af-8a67-4c06-a471-3fb980d88a8f" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:05 devstack sudo[104567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1862988-e545-4b3a-bc52-0c1da6226321]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:05 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:05 devstack sudo[104569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f
Sep 30 18:06:05 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:05 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.467s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309e84e-54fd-4d3a-b48b-cd20d4466156]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:05 devstack sudo[104574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:06:05 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:05 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f" returned: 0 in 0.486s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:05 devstack sudo[104579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f
Sep 30 18:06:05 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:05 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:05 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c6e3c9af-8a67-4c06-a471-3fb980d88a8f" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.551s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-c6e3c9af-8a67-4c06-a471-3fb980d88a8f" released by "delete_volume" :: held 0.929s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:05 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img
Sep 30 18:06:05 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Created reservations ['021226cc-b1b3-4546-b1ca-7be50afd1d19', '564da574-6ba1-4272-8e3d-23198e717b31', 'eb553300-6039-4708-af65-b5de932caeb8', '0a979cc9-ebf8-4021-a55b-ae6508c617c5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:06 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:06 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:06 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.574s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Deleted volume successfully.
Sep 30 18:06:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ebf011a-8928-447e-8ee5-cf0619b49d88 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-c6e3c9af-8a67-4c06-a471-3fb980d88a8f-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:07 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (b20ad885-8bf9-464c-9f6d-8735301b7924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdb32db-4ea4-4492-b269-11b3a12ae631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdb32db-4ea4-4492-b269-11b3a12ae631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98559364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c685a8fd-c36d-4114-b6b5-79e78fb3fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:08Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f65387-85c5-418f-8526-58c1068f34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f65387-85c5-418f-8526-58c1068f34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5861d04-e4c3-424e-9b21-b06791d90f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5861d04-e4c3-424e-9b21-b06791d90f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c685a8fd-c36d-4114-b6b5-79e78fb3fec7', 'volume_name': 'volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42564c2b-8c55-496a-9ce0-0fe296ae8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42564c2b-8c55-496a-9ce0-0fe296ae8171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde7fbc0-d205-43fe-830c-ef05cff26ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Volume c685a8fd-c36d-4114-b6b5-79e78fb3fec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7', 'volume_size': 1}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ac593093-1840-41ca-b193-6dfbe702d7e3 req-e0beb29c-f384-4fc0-8f02-267d142fc57d tempest-TestMinimumBasicScenario-730232333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:14 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img" returned: 0 in 8.642s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46c2baa-bc7c-4ab9-a5fd-b22ad6bebca6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:14 devstack sudo[104614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:06:14 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:15 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.521s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:06:15 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Converted 1024.00 MB image at 118.48 MB/s
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] f7dde15f-361e-4188-b261-f56f21e584ad was raw, converting to qcow2 {{(pid=87418) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e50711e-c7b0-4084-b800-4cc096cab24d]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:15 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img
Sep 30 18:06:15 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:15 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img" returned: 0 in 0.317s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:15 devstack sudo[104623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img
Sep 30 18:06:15 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:15 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img" returned: 1 in 0.320s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:06:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:15 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58
Sep 30 18:06:15 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:16 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:16 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Image conversion details: src /opt/stack/data/cinder/conversion/3548e279-8c14-4114-bed3-b3a6ded783aa.temp_image.f7dde15f-361e-4188-b261-f56f21e584adhtwqsoq6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:06:16 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 30 18:06:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[66348964-c337-4391-8a94-574e8ff3696c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:16 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58
Sep 30 18:06:16 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:16 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nj7_wt58" returned: 0 in 0.390s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.081s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Uploaded volume to glance image-id: f7dde15f-361e-4188-b261-f56f21e584ad. {{(pid=87418) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.712s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98559364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c685a8fd-c36d-4114-b6b5-79e78fb3fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:08Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Creating volume c685a8fd-c36d-4114-b6b5-79e78fb3fec7 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:17 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:17 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 1073741824
Sep 30 18:06:17 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c40bf05a-dbdf-418c-8049-3bb6b41c0808 tempest-VolumesActionsTest-1260703015 None] Copy volume to image completed successfully.
Sep 30 18:06:18 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 1073741824" returned: 0 in 0.515s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:18 devstack sudo[104648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7
Sep 30 18:06:18 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:18 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7" returned: 0 in 0.271s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ac593093-1840-41ca-b193-6dfbe702d7e3 req-e0beb29c-f384-4fc0-8f02-267d142fc57d tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.065s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-ac593093-1840-41ca-b193-6dfbe702d7e3 req-e0beb29c-f384-4fc0-8f02-267d142fc57d tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde7fbc0-d205-43fe-830c-ef05cff26ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfc9ce9-0795-46c3-9fc7-53d9a4803b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:18 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Volume volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 (c685a8fd-c36d-4114-b6b5-79e78fb3fec7): created successfully
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfc9ce9-0795-46c3-9fc7-53d9a4803b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (b20ad885-8bf9-464c-9f6d-8735301b7924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-84888b34-423c-4d22-a58d-f6c0d4c66ba9 tempest-ProjectReaderTests-1310888770 None] Created volume successfully.
Sep 30 18:06:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-ac593093-1840-41ca-b193-6dfbe702d7e3 req-e0beb29c-f384-4fc0-8f02-267d142fc57d tempest-TestMinimumBasicScenario-730232333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-a65f3f56-a04d-4c74-b135-5d606d535345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c04aada-b048-45b6-a1cd-59cdf9193466', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:06:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-ac593093-1840-41ca-b193-6dfbe702d7e3 req-e0beb29c-f384-4fc0-8f02-267d142fc57d tempest-TestMinimumBasicScenario-730232333 None] attachment_update completed successfully.
Sep 30 18:06:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Acquiring lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Acquiring lock "cinder-quobyte-3548e279-8c14-4114-bed3-b3a6ded783aa" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Lock "cinder-quobyte-3548e279-8c14-4114-bed3-b3a6ded783aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:19 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[72749ff9-e8a7-4459-9ea9-3e6cfb8044ce]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:19 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:06:19 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-c685a8fd-c36d-4114-b6b5-79e78fb3fec7-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Lock "cinder-c685a8fd-c36d-4114-b6b5-79e78fb3fec7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:20 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.524s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-quobyte-c685a8fd-c36d-4114-b6b5-79e78fb3fec7" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:20 devstack sudo[105075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa
Sep 30 18:06:20 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-c685a8fd-c36d-4114-b6b5-79e78fb3fec7" acquired by "delete_volume" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2105085-1973-4c2b-8279-52c24539894a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:20 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7
Sep 30 18:06:20 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:20 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3548e279-8c14-4114-bed3-b3a6ded783aa" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Lock "cinder-quobyte-3548e279-8c14-4114-bed3-b3a6ded783aa" released by "delete_volume" :: held 0.957s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Created reservations ['50a7d6eb-8675-47c3-925e-db710bf4e157', '516b6dc7-2c5e-4041-8d38-d5ca51327da1', 'c8c293de-8f64-47ea-aae2-d8985cee3f8d', '225ca062-2c1c-49a6-b5bb-908f1ba47c62'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:20 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7" returned: 0 in 0.503s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:20 devstack sudo[105083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:20 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:20 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7
Sep 30 18:06:20 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:21 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:21 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Deleted volume successfully.
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c685a8fd-c36d-4114-b6b5-79e78fb3fec7" returned: 0 in 0.332s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-c685a8fd-c36d-4114-b6b5-79e78fb3fec7" released by "delete_volume" :: held 0.908s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6e5c15a9-b93c-4a02-bd67-1e05d2b85b7a tempest-VolumesActionsTest-1260703015 None] Lock "cinder-3548e279-8c14-4114-bed3-b3a6ded783aa-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Created reservations ['b82e4183-4eda-4cf0-afab-dbd606749bb1', '3596b87d-de3b-434d-9118-cbe882910813', '325c2d18-ef0c-4b75-8ccb-8d2bb31d15ba', '895bd7df-587d-408c-b6cd-7d286f3c7664'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:21 devstack sudo[105089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:21 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:21 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.273s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Deleted volume successfully.
Sep 30 18:06:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea57882e-6c07-42b8-91ba-3049b6742aac tempest-ProjectReaderTests-1310888770 None] Lock "cinder-c685a8fd-c36d-4114-b6b5-79e78fb3fec7-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:22 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (bce3a4b7-d3fc-4e22-8ef0-47631046944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c802d7-f937-4dc6-8d26-c742a9a0167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c802d7-f937-4dc6-8d26-c742a9a0167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592900451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c772900-4036-49d3-bcb9-2a3485652771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:23Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b35d15-c3ef-43ac-8837-c3f797fc66bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b35d15-c3ef-43ac-8837-c3f797fc66bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd14392-0b8d-44bf-9975-032e795e0dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd14392-0b8d-44bf-9975-032e795e0dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c772900-4036-49d3-bcb9-2a3485652771', 'volume_name': 'volume-3c772900-4036-49d3-bcb9-2a3485652771', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19b92c1-728a-4f80-b66b-8e6d1a2eb9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19b92c1-728a-4f80-b66b-8e6d1a2eb9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38860a03-f69d-4d5b-acc0-a6ab29513908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Volume 3c772900-4036-49d3-bcb9-2a3485652771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c772900-4036-49d3-bcb9-2a3485652771', 'volume_size': 1}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592900451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c772900-4036-49d3-bcb9-2a3485652771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:23Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Creating volume 3c772900-4036-49d3-bcb9-2a3485652771 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:23 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:23 devstack sudo[105092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771 1073741824
Sep 30 18:06:23 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:23 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771 1073741824" returned: 0 in 0.567s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:23 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771
Sep 30 18:06:23 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:23 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771" returned: 0 in 0.299s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38860a03-f69d-4d5b-acc0-a6ab29513908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c772900-4036-49d3-bcb9-2a3485652771', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b3d613-610d-4861-a8ba-3adf188255c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Volume volume-3c772900-4036-49d3-bcb9-2a3485652771 (3c772900-4036-49d3-bcb9-2a3485652771): created successfully
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b3d613-610d-4861-a8ba-3adf188255c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (bce3a4b7-d3fc-4e22-8ef0-47631046944b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-28a0c2e5-3987-42c9-a039-fcf5aa81a701 tempest-ProjectReaderTests-1310888770 None] Created volume successfully.
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-3c772900-4036-49d3-bcb9-2a3485652771-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-3c772900-4036-49d3-bcb9-2a3485652771-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-quobyte-3c772900-4036-49d3-bcb9-2a3485652771" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-3c772900-4036-49d3-bcb9-2a3485652771" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ded45-e3f2-4ff8-8b19-8001194ea663]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:25 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771
Sep 30 18:06:25 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:25 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771" returned: 0 in 0.424s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:25 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771
Sep 30 18:06:25 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:25 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c772900-4036-49d3-bcb9-2a3485652771" returned: 0 in 0.303s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-3c772900-4036-49d3-bcb9-2a3485652771" released by "delete_volume" :: held 0.797s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Created reservations ['93528abc-d3ee-4f02-9542-a9bb1698df86', '10492f28-5b09-41e2-a2a1-3d972418bbf5', 'e82064bb-0901-451f-b14e-55fca86c7526', '47bc16fe-576d-4863-aa2e-16510a48b62a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:26 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:26 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:26 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.325s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Deleted volume successfully.
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a2f1ab18-19ac-46c5-b60d-ff9db7b159b6 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-3c772900-4036-49d3-bcb9-2a3485652771-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (4088c4da-8240-4917-8f2f-8a250d85ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63862fda-fe1a-42f1-8e24-8aa79280ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63862fda-fe1a-42f1-8e24-8aa79280ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612758827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22da7cbb-f390-41ac-a193-8bbda0e8835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:27Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcaef09-bbc2-4679-b6c2-3865d53df458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcaef09-bbc2-4679-b6c2-3865d53df458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156c4658-c114-419f-a759-856bac85eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156c4658-c114-419f-a759-856bac85eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22da7cbb-f390-41ac-a193-8bbda0e8835a', 'volume_name': 'volume-22da7cbb-f390-41ac-a193-8bbda0e8835a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b04d1ac-65c2-4166-939e-e500e363c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b04d1ac-65c2-4166-939e-e500e363c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9121aa-d433-4771-bf4b-348831721542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Volume 22da7cbb-f390-41ac-a193-8bbda0e8835a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22da7cbb-f390-41ac-a193-8bbda0e8835a', 'volume_size': 1}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612758827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22da7cbb-f390-41ac-a193-8bbda0e8835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89db46d80884584913f39322b32612e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:27Z,use_quota=True,user_id='042e9036386c4e2cb94448c1084f7136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Creating volume 22da7cbb-f390-41ac-a193-8bbda0e8835a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:26 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:27 devstack sudo[105116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a 1073741824
Sep 30 18:06:27 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:27 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a 1073741824" returned: 0 in 0.668s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:27 devstack sudo[105122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a
Sep 30 18:06:27 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:28 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a" returned: 0 in 0.457s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9121aa-d433-4771-bf4b-348831721542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22da7cbb-f390-41ac-a193-8bbda0e8835a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa295cc-89f1-47b5-8b38-6583f2036eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Volume volume-22da7cbb-f390-41ac-a193-8bbda0e8835a (22da7cbb-f390-41ac-a193-8bbda0e8835a): created successfully
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa295cc-89f1-47b5-8b38-6583f2036eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Flow 'volume_create_manager' (4088c4da-8240-4917-8f2f-8a250d85ec93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-18f810b2-3b04-4132-97a6-c53f44c947bf tempest-ProjectReaderTests-1310888770 None] Created volume successfully.
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-22da7cbb-f390-41ac-a193-8bbda0e8835a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-22da7cbb-f390-41ac-a193-8bbda0e8835a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "cinder-quobyte-22da7cbb-f390-41ac-a193-8bbda0e8835a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-22da7cbb-f390-41ac-a193-8bbda0e8835a" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f6600-ecaf-4f97-a7e9-771ebbe6d651]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:29 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a
Sep 30 18:06:29 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:29 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a" returned: 0 in 0.453s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:29 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a
Sep 30 18:06:29 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:29 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-22da7cbb-f390-41ac-a193-8bbda0e8835a" returned: 0 in 0.308s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-quobyte-22da7cbb-f390-41ac-a193-8bbda0e8835a" released by "delete_volume" :: held 0.852s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Created reservations ['d3aeabb5-8284-4fe2-bec0-6073567f1569', '05394829-7c49-4a12-8add-cfadc3edb42b', '096da373-7f89-4195-a075-77f8483b4187', '541b240c-dfb7-4171-a7fb-ef0c5e2334c5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:30 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:30 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:30 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.484s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Deleted volume successfully.
Sep 30 18:06:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-57f4cc09-6aab-4e9b-8111-0037c036a518 tempest-ProjectReaderTests-1310888770 None] Lock "cinder-22da7cbb-f390-41ac-a193-8bbda0e8835a-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:34 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Flow 'volume_create_manager' (d55c52f0-42c7-4fcd-a20a-8110d8723623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8be52c8-e21e-4962-a5c5-98a74d9a7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8be52c8-e21e-4962-a5c5-98a74d9a7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1984240548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1adf5c-fad2-4d11-a2cf-5a7f958e625f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a775b5890c49c68c8a2a953ecf23b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:35Z,use_quota=True,user_id='bd1efdaec56440708b5cfa4d8785c473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40dfac31-2580-4140-b445-7639dcc03970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40dfac31-2580-4140-b445-7639dcc03970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3a8b77-d387-4eb7-ac21-e0b72b7d71a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (af22ca38-2c49-40b6-8e99-3166ba639789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da1435f-9fba-440e-b3f8-dc7b559645e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da1435f-9fba-440e-b3f8-dc7b559645e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508286998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7548bf-5ad8-4264-ab94-31e2fb81ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:35Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee47d21-a338-4b41-8087-a6250da79af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee47d21-a338-4b41-8087-a6250da79af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549c361f-b029-4abe-9450-d74898a093d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549c361f-b029-4abe-9450-d74898a093d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7548bf-5ad8-4264-ab94-31e2fb81ec99', 'volume_name': 'volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288c10d6-469e-4d0d-aab8-a8f2cea95ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288c10d6-469e-4d0d-aab8-a8f2cea95ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3583db19-6074-465a-8a5d-9a4e5e0df4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume 5e7548bf-5ad8-4264-ab94-31e2fb81ec99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99', 'volume_size': 1}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508286998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7548bf-5ad8-4264-ab94-31e2fb81ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:35Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating volume 5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:35 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:35 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 1073741824
Sep 30 18:06:35 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3a8b77-d387-4eb7-ac21-e0b72b7d71a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac1adf5c-fad2-4d11-a2cf-5a7f958e625f', 'volume_name': 'volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f4011f0>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68085317-6416-4751-98de-b73587e7a590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68085317-6416-4751-98de-b73587e7a590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4610e0a-a312-4c30-8790-d74e0bef888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Volume ac1adf5c-fad2-4d11-a2cf-5a7f958e625f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f4011f0>}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Trying to clone ac1adf5c-fad2-4d11-a2cf-5a7f958e625f from image 90139efc-54c0-4670-ab72-2da0af285eb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:06:35 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 1073741824" returned: 0 in 0.553s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:06:35 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:35 devstack sudo[105151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99
Sep 30 18:06:35 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a957b4-2466-4a81-92fb-cfc8b78519a2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:36 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD
Sep 30 18:06:36 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:36 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3583db19-6074-465a-8a5d-9a4e5e0df4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5999ea90-a917-43c6-9ab5-58c976916dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:36 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 (5e7548bf-5ad8-4264-ab94-31e2fb81ec99): created successfully
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5999ea90-a917-43c6-9ab5-58c976916dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (af22ca38-2c49-40b6-8e99-3166ba639789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d1fb5f56-380f-49de-881d-68c64d5c219a tempest-CreateVolumesFromSnapshotTest-367514127 None] Created volume successfully.
Sep 30 18:06:36 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 is fetched for user bd1efdaec56440708b5cfa4d8785c473. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ea929-fd26-47c4-9d49-8f3d874c6ef7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:36 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD
Sep 30 18:06:36 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:36 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1984240548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1adf5c-fad2-4d11-a2cf-5a7f958e625f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a775b5890c49c68c8a2a953ecf23b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:35Z,use_quota=True,user_id='bd1efdaec56440708b5cfa4d8785c473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Creating volume ac1adf5c-fad2-4d11-a2cf-5a7f958e625f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:36 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:36 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f 1073741824
Sep 30 18:06:36 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:37 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f 1073741824" returned: 0 in 0.498s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:37 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f
Sep 30 18:06:37 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:37 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating offline snapshot 3a352033-5096-4224-ba2f-38e36f154353 of volume 5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f32fc6-8ebf-474e-ab0d-8a4738f0177e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Attempting download of 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume ac1adf5c-fad2-4d11-a2cf-5a7f958e625f. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5024cf5-77b6-4024-b81d-294f8accf4a7]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:37 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99
Sep 30 18:06:37 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:37 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj
Sep 30 18:06:37 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:37 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" returned: 0 in 0.389s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:37 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj" returned: 0 in 0.339s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:37 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 1G
Sep 30 18:06:37 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:38 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj
Sep 30 18:06:38 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:38 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj" returned: 1 in 0.342s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90139efc-54c0-4670-ab72-2da0af285eb6_3u0ou9aj' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b9b66-318b-4e9a-936b-83fdc09ad275]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:38 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 1G" returned: 0 in 0.463s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:38 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD
Sep 30 18:06:38 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:38 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353
Sep 30 18:06:38 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:38 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] 90139efc-54c0-4670-ab72-2da0af285eb6 was qcow2, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:38 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f
Sep 30 18:06:38 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:38 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353" returned: 0 in 0.318s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:38 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 is being set with open permissions: ugo+rw
Sep 30 18:06:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:38 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353
Sep 30 18:06:38 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:39 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:39 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info
Sep 30 18:06:39 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:39 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:39 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info is being set with open permissions: ugo+rw
Sep 30 18:06:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:39 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info
Sep 30 18:06:39 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:39 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.info" returned: 0 in 0.308s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-45599307-d2db-4164-aa3c-f403509703d8 tempest-CreateVolumesFromSnapshotTest-367514127 None] Create snapshot completed successfully
Sep 30 18:06:40 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" returned: 0 in 2.041s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:40 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90139efc-54c0-4670-ab72-2da0af285eb6_9s4l1lhfdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:06:40 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Converted 112.00 MB image at 54.81 MB/s
Sep 30 18:06:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:40 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f 1G
Sep 30 18:06:40 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (fc7d4485-4bd9-4ea6-986b-0272c90e565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451b9d89-420c-4b3e-9fcd-47d632aa5bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451b9d89-420c-4b3e-9fcd-47d632aa5bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-962832656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d3a0fb-46a1-4413-9492-1a74c8428580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:41Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e295e1d1-b35f-4b06-a739-7842277b6579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e295e1d1-b35f-4b06-a739-7842277b6579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc39f2b-d801-4478-a088-8aa73dced890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc39f2b-d801-4478-a088-8aa73dced890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d3a0fb-46a1-4413-9492-1a74c8428580', 'volume_name': 'volume-58d3a0fb-46a1-4413-9492-1a74c8428580', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1ef8ba-0cc5-422d-8daa-ea347195f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1ef8ba-0cc5-422d-8daa-ea347195f42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90cc7a4-6aef-43ba-a7c3-ed59d7fa6e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume 58d3a0fb-46a1-4413-9492-1a74c8428580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d3a0fb-46a1-4413-9492-1a74c8428580', 'volume_size': 1}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-962832656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d3a0fb-46a1-4413-9492-1a74c8428580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:41Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating volume 58d3a0fb-46a1-4413-9492-1a74c8428580 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:41 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f 1G" returned: 0 in 0.659s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Downloaded image 90139efc-54c0-4670-ab72-2da0af285eb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}])) to volume ac1adf5c-fad2-4d11-a2cf-5a7f958e625f successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Temporary image 90139efc-54c0-4670-ab72-2da0af285eb6 for user bd1efdaec56440708b5cfa4d8785c473 is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Marking volume ac1adf5c-fad2-4d11-a2cf-5a7f958e625f as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:06:41 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580 1073741824
Sep 30 18:06:41 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Copying metadata from image 90139efc-54c0-4670-ab72-2da0af285eb6 to ac1adf5c-fad2-4d11-a2cf-5a7f958e625f. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Creating volume glance metadata for volume ac1adf5c-fad2-4d11-a2cf-5a7f958e625f backed by image 90139efc-54c0-4670-ab72-2da0af285eb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4610e0a-a312-4c30-8790-d74e0bef888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f', 'volume_size': 1, 'image_id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90139efc-54c0-4670-ab72-2da0af285eb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '936bc7dc8812446eae6699a807b32da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90139efc-54c0-4670-ab72-2da0af285eb6', 'created_at': datetime.datetime(2026, 9, 30, 15, 46, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90139efc-54c0-4670-ab72-2da0af285eb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f4011f0>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a571e0-0516-4bf8-afe6-bd72c48a1c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Volume volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f (ac1adf5c-fad2-4d11-a2cf-5a7f958e625f): created successfully
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a571e0-0516-4bf8-afe6-bd72c48a1c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Flow 'volume_create_manager' (d55c52f0-42c7-4fcd-a20a-8110d8723623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-52d2f52f-e84b-4d3a-bdb1-d6a2a3f580fd tempest-TestShelveInstance-1006687766 None] Created volume successfully.
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (98bc71ae-2c9b-407d-a7fe-b5414ca54cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb41c43-633d-4204-98dc-6f09fd890a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb41c43-633d-4204-98dc-6f09fd890a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1884008852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b81e15-704f-4ecd-8691-d736a98534f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:42Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20f6d49-f57f-4569-8e6a-1502de0fcd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20f6d49-f57f-4569-8e6a-1502de0fcd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53a653d-dfa5-4c6e-8ab2-70a1cabc13ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53a653d-dfa5-4c6e-8ab2-70a1cabc13ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b81e15-704f-4ecd-8691-d736a98534f4', 'volume_name': 'volume-d2b81e15-704f-4ecd-8691-d736a98534f4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb0adbf-9797-4b63-a41b-139fe09fe6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb0adbf-9797-4b63-a41b-139fe09fe6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2f5f71-f19e-49d0-950c-a48ec7a0f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:41 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume d2b81e15-704f-4ecd-8691-d736a98534f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b81e15-704f-4ecd-8691-d736a98534f4', 'volume_size': 1}
Sep 30 18:06:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:42 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580 1073741824" returned: 0 in 0.668s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:42 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580
Sep 30 18:06:42 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (7dc8fdf1-06fc-4e96-9b39-be7e0a3665fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ff8de9-c31f-4271-8a1d-7cce9ee53631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ff8de9-c31f-4271-8a1d-7cce9ee53631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148068136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da1041d-e849-4a37-988c-434c57981f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:42Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc30bde4-2f39-4358-ae6a-6afc1c7c8546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc30bde4-2f39-4358-ae6a-6afc1c7c8546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1222a05-ba3e-404e-98bc-4c2c70d052d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1222a05-ba3e-404e-98bc-4c2c70d052d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da1041d-e849-4a37-988c-434c57981f50', 'volume_name': 'volume-5da1041d-e849-4a37-988c-434c57981f50', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ea096-295e-42d8-b462-58875046e98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ea096-295e-42d8-b462-58875046e98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f1b1cd-bbc2-42fb-8930-af522a014df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:42 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume 5da1041d-e849-4a37-988c-434c57981f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da1041d-e849-4a37-988c-434c57981f50', 'volume_size': 1}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:42 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580" returned: 0 in 0.485s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1884008852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b81e15-704f-4ecd-8691-d736a98534f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:42Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating volume d2b81e15-704f-4ecd-8691-d736a98534f4 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:42 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:42 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4 1073741824
Sep 30 18:06:42 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90cc7a4-6aef-43ba-a7c3-ed59d7fa6e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d3a0fb-46a1-4413-9492-1a74c8428580', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d83eaa7-32d8-4e6e-a868-f6aeed735c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:42 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume volume-58d3a0fb-46a1-4413-9492-1a74c8428580 (58d3a0fb-46a1-4413-9492-1a74c8428580): created successfully
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d83eaa7-32d8-4e6e-a868-f6aeed735c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (fc7d4485-4bd9-4ea6-986b-0272c90e565e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-00a9417a-3c0b-4b0d-9d48-6dc1bfa2b76d tempest-CreateVolumesFromSnapshotTest-367514127 None] Created volume successfully.
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (c38b9476-30e5-48b1-bc1b-fe2894a078f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46f567b-8376-4abe-a488-4c695c6a285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46f567b-8376-4abe-a488-4c695c6a285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990627690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6fff7e-71b1-46fc-b936-0ff4ea57bac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:43Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a75ef4d-9d9f-4e83-b65f-75b745c923c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a75ef4d-9d9f-4e83-b65f-75b745c923c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96ef8fb-8a8b-4b65-9a87-dae299e10721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96ef8fb-8a8b-4b65-9a87-dae299e10721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6fff7e-71b1-46fc-b936-0ff4ea57bac9', 'volume_name': 'volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6eac14-96c3-437f-8cd6-1de913e97a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6eac14-96c3-437f-8cd6-1de913e97a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd68933-c944-42f7-ad44-f0fde89d791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume 0b6fff7e-71b1-46fc-b936-0ff4ea57bac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9', 'volume_size': 1}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (ea88d6fe-00fe-4d44-afc9-086027a93a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e86ea5b-7d4d-47a1-85a0-08562db19e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e86ea5b-7d4d-47a1-85a0-08562db19e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637473732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51589f17-b633-4dc6-80e9-527ef32e11b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:43Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaf1957-2f8a-4bb5-b6e1-ca3f18b34023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaf1957-2f8a-4bb5-b6e1-ca3f18b34023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dd881f-5b41-4f2d-84f6-e758aa151f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dd881f-5b41-4f2d-84f6-e758aa151f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51589f17-b633-4dc6-80e9-527ef32e11b0', 'volume_name': 'volume-51589f17-b633-4dc6-80e9-527ef32e11b0', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc5e02d-1d95-4dda-8062-59aa0f35f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc5e02d-1d95-4dda-8062-59aa0f35f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143380b4-cd2a-4b37-91a4-6c61cb410ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume 51589f17-b633-4dc6-80e9-527ef32e11b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51589f17-b633-4dc6-80e9-527ef32e11b0', 'volume_size': 1}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:43 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4 1073741824" returned: 0 in 0.849s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:43 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4
Sep 30 18:06:43 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:43 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4" returned: 0 in 0.279s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148068136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da1041d-e849-4a37-988c-434c57981f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:42Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating volume 5da1041d-e849-4a37-988c-434c57981f50 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:43 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2f5f71-f19e-49d0-950c-a48ec7a0f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b81e15-704f-4ecd-8691-d736a98534f4', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50 1073741824
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ee9614-32cd-42b8-93b5-3e64a04980e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:43 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:43 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume volume-d2b81e15-704f-4ecd-8691-d736a98534f4 (d2b81e15-704f-4ecd-8691-d736a98534f4): created successfully
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ee9614-32cd-42b8-93b5-3e64a04980e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (98bc71ae-2c9b-407d-a7fe-b5414ca54cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:43 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-997400d7-347b-4a76-9ad6-219c54718300 tempest-CreateVolumesFromSnapshotTest-367514127 None] Created volume successfully.
Sep 30 18:06:44 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50 1073741824" returned: 0 in 0.577s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:44 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50
Sep 30 18:06:44 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:44 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990627690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6fff7e-71b1-46fc-b936-0ff4ea57bac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:43Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating volume 0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:44 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:44 devstack sudo[105338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 1073741824
Sep 30 18:06:44 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f1b1cd-bbc2-42fb-8930-af522a014df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da1041d-e849-4a37-988c-434c57981f50', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8bdb3a-396d-4662-9eb5-ab46bc72cef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:44 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume volume-5da1041d-e849-4a37-988c-434c57981f50 (5da1041d-e849-4a37-988c-434c57981f50): created successfully
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8bdb3a-396d-4662-9eb5-ab46bc72cef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (7dc8fdf1-06fc-4e96-9b39-be7e0a3665fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-415a28b8-c482-4160-81f9-57ff55636a1a tempest-CreateVolumesFromSnapshotTest-367514127 None] Created volume successfully.
Sep 30 18:06:45 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 1073741824" returned: 0 in 0.534s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:45 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9
Sep 30 18:06:45 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:45 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9" returned: 0 in 0.296s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.180s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637473732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51589f17-b633-4dc6-80e9-527ef32e11b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58b7506ad1442a7b0a10675018ebf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:06:43Z,use_quota=True,user_id='f3978ba33acc4eaf99bd932cb1004842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Creating volume 51589f17-b633-4dc6-80e9-527ef32e11b0 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:06:45 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:45 devstack sudo[105347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0 1073741824
Sep 30 18:06:45 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd68933-c944-42f7-ad44-f0fde89d791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222b5549-522e-4a4e-98bc-95c4648ffb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:45 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 (0b6fff7e-71b1-46fc-b936-0ff4ea57bac9): created successfully
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222b5549-522e-4a4e-98bc-95c4648ffb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (c38b9476-30e5-48b1-bc1b-fe2894a078f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:45 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dc44dd85-1563-4210-ae98-3d83f6b80d76 tempest-CreateVolumesFromSnapshotTest-367514127 None] Created volume successfully.
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1a7a81a8-0663-4457-8218-4e39069965b1 req-d3979ec7-ad20-49c6-80ce-8f17853f4ce3 tempest-TestShelveInstance-1006687766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:46 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0 1073741824" returned: 0 in 0.640s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:46 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0
Sep 30 18:06:46 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:46 devstack sudo[105364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:46 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:46 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0" returned: 0 in 0.393s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1a7a81a8-0663-4457-8218-4e39069965b1 req-d3979ec7-ad20-49c6-80ce-8f17853f4ce3 tempest-TestShelveInstance-1006687766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.543s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-1a7a81a8-0663-4457-8218-4e39069965b1 req-d3979ec7-ad20-49c6-80ce-8f17853f4ce3 tempest-TestShelveInstance-1006687766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143380b4-cd2a-4b37-91a4-6c61cb410ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51589f17-b633-4dc6-80e9-527ef32e11b0', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af77c92-eea8-4ba7-a563-228e3ab02f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:06:46 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Volume volume-51589f17-b633-4dc6-80e9-527ef32e11b0 (51589f17-b633-4dc6-80e9-527ef32e11b0): created successfully
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af77c92-eea8-4ba7-a563-228e3ab02f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Flow 'volume_create_manager' (ea88d6fe-00fe-4d44-afc9-086027a93a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:06:46 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-06fa8f19-0eac-455c-a836-9a3cc9d81980 tempest-CreateVolumesFromSnapshotTest-367514127 None] Created volume successfully.
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-1a7a81a8-0663-4457-8218-4e39069965b1 req-d3979ec7-ad20-49c6-80ce-8f17853f4ce3 tempest-TestShelveInstance-1006687766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09d21760-3397-440c-b26a-05fb2d19512d', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:06:46 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.464s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:06:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:06:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-1a7a81a8-0663-4457-8218-4e39069965b1 req-d3979ec7-ad20-49c6-80ce-8f17853f4ce3 tempest-TestShelveInstance-1006687766 None] attachment_update completed successfully.
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-51589f17-b633-4dc6-80e9-527ef32e11b0-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-51589f17-b633-4dc6-80e9-527ef32e11b0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-51589f17-b633-4dc6-80e9-527ef32e11b0" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-51589f17-b633-4dc6-80e9-527ef32e11b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d090fb3-a807-46b6-ad63-27ed3922ce1c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:47 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0
Sep 30 18:06:47 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:47 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0" returned: 0 in 0.466s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:47 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0
Sep 30 18:06:47 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:48 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-51589f17-b633-4dc6-80e9-527ef32e11b0" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-51589f17-b633-4dc6-80e9-527ef32e11b0" released by "delete_volume" :: held 0.943s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['c8df46f0-0fac-4e85-bcb6-685d38141d86', 'f4cd3c4f-a168-4a2c-b929-21c58f35c0a6', '72ab8205-a68b-4757-b479-ac3e19676f99', '4c2ac7ee-0102-4468-8002-b00ad2cb4ff6'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:48 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:48 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f6af5-d77f-4463-8b07-284f966675a6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:48 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9
Sep 30 18:06:48 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:48 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.439s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleted volume successfully.
Sep 30 18:06:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f4dcc0e2-da1b-4a73-9cad-6d201a1841a4 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-51589f17-b633-4dc6-80e9-527ef32e11b0-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:49 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9" returned: 0 in 0.436s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:49 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9
Sep 30 18:06:49 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:49 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9" returned: 0 in 0.757s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9" released by "delete_volume" :: held 1.285s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['143b5600-7422-4b98-9ac5-6c817b5cb0ba', '89ddcae4-9aef-46fb-b862-0a71f523b80c', 'e9d2c204-3dc6-46c5-8d7c-606826cc23da', 'd62354f1-68d6-40d5-a7d9-5e4027995bc6'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:50 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:50 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:50 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.569s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleted volume successfully.
Sep 30 18:06:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-56e0f1b6-76e9-4533-82c1-348b1863f5bd tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-0b6fff7e-71b1-46fc-b936-0ff4ea57bac9-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-5da1041d-e849-4a37-988c-434c57981f50-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-5da1041d-e849-4a37-988c-434c57981f50-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-5da1041d-e849-4a37-988c-434c57981f50" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-5da1041d-e849-4a37-988c-434c57981f50" acquired by "delete_volume" :: waited 0.067s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7376e1-d950-439c-82b9-e94c11694161]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:51 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50
Sep 30 18:06:51 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:51 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50" returned: 0 in 0.521s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:51 devstack sudo[105514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50
Sep 30 18:06:51 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:52 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5da1041d-e849-4a37-988c-434c57981f50" returned: 0 in 0.277s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-5da1041d-e849-4a37-988c-434c57981f50" released by "delete_volume" :: held 0.871s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['ec110a62-0c95-4c35-b862-34b5d1a341e3', '3752d682-788e-485b-b306-345daf88513f', '428b26e0-599c-4143-8943-1e66a8489556', '9315c98e-51cb-41a3-b0da-da25ee4359a7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:52 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:52 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-d2b81e15-704f-4ecd-8691-d736a98534f4-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-d2b81e15-704f-4ecd-8691-d736a98534f4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-d2b81e15-704f-4ecd-8691-d736a98534f4" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-d2b81e15-704f-4ecd-8691-d736a98534f4" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161529f-0ab1-48a3-a0b8-9165bfe29673]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:52 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.429s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleted volume successfully.
Sep 30 18:06:52 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4
Sep 30 18:06:52 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b98e84b5-e988-4fc0-9cbb-2ee599ce3a8b tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-5da1041d-e849-4a37-988c-434c57981f50-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:52 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4" returned: 0 in 0.439s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:53 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4
Sep 30 18:06:53 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:53 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d2b81e15-704f-4ecd-8691-d736a98534f4" returned: 0 in 0.419s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-d2b81e15-704f-4ecd-8691-d736a98534f4" released by "delete_volume" :: held 0.929s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['db0ad9fa-8495-4edf-bf7b-cd919784dfc3', 'e5288e33-e906-4234-9a47-aa0410608c5b', 'b1fc9a7b-e9c9-452a-b642-ab13bc63de02', 'f35d9c28-d51f-4aff-b89e-0f4a807da38d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:53 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:53 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:53 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.277s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:53 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleted volume successfully.
Sep 30 18:06:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a87343a1-b84e-4c6a-9073-67a9b1ec9e5c tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-d2b81e15-704f-4ecd-8691-d736a98534f4-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-58d3a0fb-46a1-4413-9492-1a74c8428580-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-58d3a0fb-46a1-4413-9492-1a74c8428580-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-58d3a0fb-46a1-4413-9492-1a74c8428580" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-58d3a0fb-46a1-4413-9492-1a74c8428580" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:54 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b275610-fee7-4183-a330-93a089e96c89]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:54 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580
Sep 30 18:06:54 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:55 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580" returned: 0 in 0.460s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:55 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580
Sep 30 18:06:55 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:55 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-58d3a0fb-46a1-4413-9492-1a74c8428580" returned: 0 in 0.313s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-58d3a0fb-46a1-4413-9492-1a74c8428580" released by "delete_volume" :: held 0.848s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['c5248428-ab58-48ac-9c18-3e3cb1a842ae', '2fbef01e-0d48-490a-9d2a-b9301bf93e2a', '29601d91-e231-4464-9793-95c1d563b133', '74d3fc5f-3c21-4c82-b1a9-0bac731c5c4c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:55 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:55 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-3a352033-5096-4224-ba2f-38e36f154353-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-3a352033-5096-4224-ba2f-38e36f154353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-3a352033-5096-4224-ba2f-38e36f154353" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-3a352033-5096-4224-ba2f-38e36f154353" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleting offline snapshot 3a352033-5096-4224-ba2f-38e36f154353 of volume 5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] snapshot_file for this snap is: volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c0a546-7beb-4294-8ea1-6c69928d4e33]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:56 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.359s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleted volume successfully.
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-81077c6a-b872-4380-9f97-33bda1376336 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-58d3a0fb-46a1-4413-9492-1a74c8428580-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:56 devstack sudo[105564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353
Sep 30 18:06:56 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:56 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353" returned: 0 in 0.455s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c803d-7a21-4cb6-a4d9-205dee54eb6f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:56 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99
Sep 30 18:06:56 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:57 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" returned: 0 in 0.508s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:57 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353
Sep 30 18:06:57 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:57 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353" returned: 0 in 0.406s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:57 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353
Sep 30 18:06:57 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:57 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99.3a352033-5096-4224-ba2f-38e36f154353" returned: 0 in 0.284s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-3a352033-5096-4224-ba2f-38e36f154353" released by "_delete_snapshot" :: held 1.798s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" released by "delete_snapshot" :: held 1.844s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['f99ee736-59c5-44d5-8258-cf149e1045a8', 'e069498e-fbe0-43c4-8aa1-3b68016298ef', '0c4b43f6-f7ed-42ee-8a95-3c7666a8c7bf', '57fdd201-29d4-4d8c-a219-337001fd5d40'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Delete snapshot completed successfully.
Sep 30 18:06:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d017826c-85c0-4505-99c0-ad5723bfd410 tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-3a352033-5096-4224-ba2f-38e36f154353-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-5e7548bf-5ad8-4264-ab94-31e2fb81ec99-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-5e7548bf-5ad8-4264-ab94-31e2fb81ec99-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "cinder-quobyte-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d8c6ff-b09b-4ed0-a3b0-408ddc944707]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:58 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99
Sep 30 18:06:58 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:58 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" returned: 0 in 0.366s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:58 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99
Sep 30 18:06:58 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:58 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-quobyte-5e7548bf-5ad8-4264-ab94-31e2fb81ec99" released by "delete_volume" :: held 0.670s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Created reservations ['186d90c1-7a28-409f-accf-10dc975dda11', 'b229147f-66d0-4270-afdb-d95786712fe3', 'be7cc81c-71bc-4d29-bd84-f70166e9b3e8', '8550cbdd-1120-418a-b4dd-60ec5dcef6b9'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:06:59 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:06:59 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:06:59 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.268s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:06:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Deleted volume successfully.
Sep 30 18:06:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d63794e2-0f41-426d-b354-9e874d3c3aec tempest-CreateVolumesFromSnapshotTest-367514127 None] Lock "cinder-5e7548bf-5ad8-4264-ab94-31e2fb81ec99-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:06 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=131,cinder:SELECT=111,cinder:INSERT=40,cinder:DELETE=10 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:07:06 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=110,cinder:UPDATE=141,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:07:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-eec6af94-0f48-49bd-8d8d-6b4f9487fbda req-0eb847d7-0f46-430a-a1db-29b153ab9f94 tempest-TestMinimumBasicScenario-730232333 None] Terminate volume connection completed successfully.
Sep 30 18:07:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-eec6af94-0f48-49bd-8d8d-6b4f9487fbda req-0eb847d7-0f46-430a-a1db-29b153ab9f94 tempest-TestMinimumBasicScenario-730232333 None] Deleting attachment 4c04aada-b048-45b6-a1cd-59cdf9193466. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:07:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Acquiring lock "cinder-a65f3f56-a04d-4c74-b135-5d606d535345-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Lock "cinder-a65f3f56-a04d-4c74-b135-5d606d535345-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Acquiring lock "cinder-quobyte-a65f3f56-a04d-4c74-b135-5d606d535345" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Lock "cinder-quobyte-a65f3f56-a04d-4c74-b135-5d606d535345" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe43a4-68b2-4a7c-9895-516a9a36f142]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:07 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345
Sep 30 18:07:07 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:07 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:07 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345
Sep 30 18:07:07 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:07 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a65f3f56-a04d-4c74-b135-5d606d535345" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Lock "cinder-quobyte-a65f3f56-a04d-4c74-b135-5d606d535345" released by "delete_volume" :: held 0.873s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Created reservations ['5d33d8a9-188b-43d0-8571-9ce54958a598', '1dc256af-b8f6-4074-a27e-766fb7686746', '61609ba0-d544-492c-882c-cb8f3014c5bd', '691a4e45-8dce-4522-85d4-901770df1050'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:08 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:08 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:08 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.294s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Deleted volume successfully.
Sep 30 18:07:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-61803245-b2ed-4e1f-958c-2c6c30b30ef3 tempest-TestMinimumBasicScenario-730232333 None] Lock "cinder-a65f3f56-a04d-4c74-b135-5d606d535345-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:18 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:07:18 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:07:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-eeb75c43-ab62-43b4-a4c4-5987f1e44927 req-e1b1ddf7-d2fa-4f60-bf37-ef12eff15356 tempest-TestShelveInstance-1006687766 None] Terminate volume connection completed successfully.
Sep 30 18:07:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-eeb75c43-ab62-43b4-a4c4-5987f1e44927 req-e1b1ddf7-d2fa-4f60-bf37-ef12eff15356 tempest-TestShelveInstance-1006687766 None] Deleting attachment 09d21760-3397-440c-b26a-05fb2d19512d. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:07:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-582ccedd-9e4e-4314-9968-5245b64154c4 req-d7264642-0713-4e29-aecc-9ce4208e84a3 tempest-TestShelveInstance-1006687766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-582ccedd-9e4e-4314-9968-5245b64154c4 req-d7264642-0713-4e29-aecc-9ce4208e84a3 tempest-TestShelveInstance-1006687766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-582ccedd-9e4e-4314-9968-5245b64154c4 req-d7264642-0713-4e29-aecc-9ce4208e84a3 tempest-TestShelveInstance-1006687766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-582ccedd-9e4e-4314-9968-5245b64154c4 req-d7264642-0713-4e29-aecc-9ce4208e84a3 tempest-TestShelveInstance-1006687766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f', 'name': 'volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc579e84-b6df-4643-8f15-69175cd4fc05', 'enforce_multipath': True} {{(pid=87418) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 30 18:07:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-582ccedd-9e4e-4314-9968-5245b64154c4 req-d7264642-0713-4e29-aecc-9ce4208e84a3 tempest-TestShelveInstance-1006687766 None] attachment_update completed successfully.
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Flow 'volume_create_manager' (f85b2353-1858-4303-a3de-8073c730f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026d46dd-2bdc-4729-829e-9bf2505558c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026d46dd-2bdc-4729-829e-9bf2505558c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-242017228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ea56b3-5b08-4631-9029-2452950cb721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac754ac580b24d3585dde258dbe9ea32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:28Z,use_quota=True,user_id='4d685c703b4f437cb6f3f1a7b2cb79e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996925d4-95b4-4fce-a3c2-cc21fab31699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996925d4-95b4-4fce-a3c2-cc21fab31699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaa2ddc-eaea-4a6a-bd1c-1e4ae1676db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaa2ddc-eaea-4a6a-bd1c-1e4ae1676db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ea56b3-5b08-4631-9029-2452950cb721', 'volume_name': 'volume-33ea56b3-5b08-4631-9029-2452950cb721', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ac4fbe-6e2c-4da7-83fa-247191b9057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ac4fbe-6e2c-4da7-83fa-247191b9057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c70c02a-f5d7-4d07-91ee-25b1c9ab1509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Volume 33ea56b3-5b08-4631-9029-2452950cb721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ea56b3-5b08-4631-9029-2452950cb721', 'volume_size': 1}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-242017228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ea56b3-5b08-4631-9029-2452950cb721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac754ac580b24d3585dde258dbe9ea32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:28Z,use_quota=True,user_id='4d685c703b4f437cb6f3f1a7b2cb79e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Creating volume 33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:28 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:28 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 1073741824
Sep 30 18:07:28 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:29 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 1073741824" returned: 0 in 0.549s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:29 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721
Sep 30 18:07:29 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:29 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721" returned: 0 in 0.323s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c70c02a-f5d7-4d07-91ee-25b1c9ab1509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ea56b3-5b08-4631-9029-2452950cb721', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2d7b27-8579-4923-ac0a-ed85bf8a4d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:29 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Volume volume-33ea56b3-5b08-4631-9029-2452950cb721 (33ea56b3-5b08-4631-9029-2452950cb721): created successfully
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2d7b27-8579-4923-ac0a-ed85bf8a4d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Flow 'volume_create_manager' (f85b2353-1858-4303-a3de-8073c730f726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-85dfff09-5e6b-4e1e-b1d9-25a03608fcec tempest-SnapshotDependencyTests-605115108 None] Created volume successfully.
Sep 30 18:07:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Creating offline snapshot c0c6c361-605c-413b-ba42-692db16adefb of volume 33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:07:30 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[999016c4-29b5-4ed4-91b6-5b5c63086be4]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:31 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721
Sep 30 18:07:31 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Flow 'volume_create_manager' (57db481b-cccd-41da-acf2-1cd8df6929c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e6e8bd-1eec-410a-ace0-88c2130c8dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e6e8bd-1eec-410a-ace0-88c2130c8dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31eec6da-85aa-4e24-9978-71d5d51d8f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee19c751c9843988508678e1ec46da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:31Z,use_quota=True,user_id='6a792a4a09e141fd956141b86cb59817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d7e00a-8c1b-441b-bd69-6622e0b33cc0),volume_type_id=f7d7e00a-8c1b-441b-bd69-6622e0b33cc0)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99abe8bb-01af-4585-9014-9a1b35c2263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99abe8bb-01af-4585-9014-9a1b35c2263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4b4a80-e069-4128-8a74-d45dec7818d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:07:31 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721" returned: 0 in 0.658s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:31 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb 1G
Sep 30 18:07:31 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4b4a80-e069-4128-8a74-d45dec7818d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31eec6da-85aa-4e24-9978-71d5d51d8f85', 'volume_name': 'volume-31eec6da-85aa-4e24-9978-71d5d51d8f85', 'volume_size': 1, 'image_id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7efab0d85510c896658053f1d16540cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dee19c751c9843988508678e1ec46da1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47b05909c03d3a144f71b4ecd56767618673f3d6768c688ba26228780a6df7dd55dca01e64e31cce349d81e59eca3619c2cd71406804dc3175f8be1510cc67c7', 'id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'created_at': datetime.datetime(2026, 9, 30, 16, 7, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 7, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f48a990>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6efbd24-979a-42eb-886b-faa4c396aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6efbd24-979a-42eb-886b-faa4c396aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694536ec-5c1a-4435-87e5-6ee79e4bb9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:32 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Volume 31eec6da-85aa-4e24-9978-71d5d51d8f85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31eec6da-85aa-4e24-9978-71d5d51d8f85', 'volume_size': 1, 'image_id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7efab0d85510c896658053f1d16540cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dee19c751c9843988508678e1ec46da1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47b05909c03d3a144f71b4ecd56767618673f3d6768c688ba26228780a6df7dd55dca01e64e31cce349d81e59eca3619c2cd71406804dc3175f8be1510cc67c7', 'id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'created_at': datetime.datetime(2026, 9, 30, 16, 7, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 7, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f48a990>}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Trying to clone 31eec6da-85aa-4e24-9978-71d5d51d8f85 from image ba5b0297-364e-4de0-8d73-ab96ca8d837e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:07:32 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 18:07:32 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb 1G" returned: 0 in 0.724s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ea56b3-5b08-4631-9029-2452950cb721 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd5b0a-f159-4b86-9783-a235d6c8ca6e]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:32 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ea56b3-5b08-4631-9029-2452950cb721 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb
Sep 30 18:07:32 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:32 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD
Sep 30 18:07:32 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:32 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ea56b3-5b08-4631-9029-2452950cb721 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:32 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb is being set with open permissions: ugo+rw
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:32 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb
Sep 30 18:07:32 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:32 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:32 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD
Sep 30 18:07:32 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:32 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:33 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info
Sep 30 18:07:33 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:33 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Temporary image ba5b0297-364e-4de0-8d73-ab96ca8d837e is fetched for user 6a792a4a09e141fd956141b86cb59817. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46bc8a4-cf65-40de-a37d-0276e4fb1ac0]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:33 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info" returned: 0 in 0.333s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:33 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info is being set with open permissions: ugo+rw
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:33 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info
Sep 30 18:07:33 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:33 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD
Sep 30 18:07:33 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:33 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.info" returned: 0 in 0.253s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:33 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-66e520c9-6b45-4a5a-87df-ffa336adb3a8 tempest-SnapshotDependencyTests-605115108 None] Create snapshot completed successfully
Sep 30 18:07:33 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD
Sep 30 18:07:33 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:34 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31eec6da-85aa-4e24-9978-71d5d51d8f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee19c751c9843988508678e1ec46da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:31Z,use_quota=True,user_id='6a792a4a09e141fd956141b86cb59817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d7e00a-8c1b-441b-bd69-6622e0b33cc0),volume_type_id=f7d7e00a-8c1b-441b-bd69-6622e0b33cc0)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Creating volume 31eec6da-85aa-4e24-9978-71d5d51d8f85 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:34 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:34 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 1073741824
Sep 30 18:07:34 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:34 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 1073741824" returned: 0 in 0.694s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:34 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85
Sep 30 18:07:34 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Flow 'volume_create_manager' (63d27d69-0709-400d-8441-f428d644353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a441f0-a4c2-4639-b3d5-53bd3f821277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a441f0-a4c2-4639-b3d5-53bd3f821277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be5453c-066f-4e3a-a45c-db0b32446840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac754ac580b24d3585dde258dbe9ea32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0c6c361-605c-413b-ba42-692db16adefb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:35Z,use_quota=True,user_id='4d685c703b4f437cb6f3f1a7b2cb79e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1494afd3-31ca-40a3-b75d-f02e9f5b957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1494afd3-31ca-40a3-b75d-f02e9f5b957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1d530a-b032-4cf4-9968-678be7e349c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1d530a-b032-4cf4-9968-678be7e349c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6be5453c-066f-4e3a-a45c-db0b32446840', 'volume_name': 'volume-6be5453c-066f-4e3a-a45c-db0b32446840', 'volume_size': 1, 'snapshot_id': 'c0c6c361-605c-413b-ba42-692db16adefb'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b07caa0-4054-4d88-9aca-6661b83f2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b07caa0-4054-4d88-9aca-6661b83f2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea639e3-23e4-4d56-b153-70e76b67d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Volume 6be5453c-066f-4e3a-a45c-db0b32446840: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6be5453c-066f-4e3a-a45c-db0b32446840', 'volume_size': 1, 'snapshot_id': 'c0c6c361-605c-413b-ba42-692db16adefb'}
Sep 30 18:07:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:35 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85" returned: 0 in 0.276s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.081s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-quobyte-c0c6c361-605c-413b-ba42-692db16adefb-6be5453c-066f-4e3a-a45c-db0b32446840" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-c0c6c361-605c-413b-ba42-692db16adefb-6be5453c-066f-4e3a-a45c-db0b32446840" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Creating volume 6be5453c-066f-4e3a-a45c-db0b32446840 from snapshot c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-quobyte-6be5453c-066f-4e3a-a45c-db0b32446840" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Attempting download of ba5b0297-364e-4de0-8d73-ab96ca8d837e ((None, [{'url': 'file:///opt/stack/data/glance/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'metadata': {}}])) to volume 31eec6da-85aa-4e24-9978-71d5d51d8f85. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-6be5453c-066f-4e3a-a45c-db0b32446840" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] snapshot: c0c6c361-605c-413b-ba42-692db16adefb, volume: 6be5453c-066f-4e3a-a45c-db0b32446840,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0b8b4f-241b-4164-a239-7e1680ecd142]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[003069e4-ee4c-46fd-8e9d-0ccb9410529f]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:35 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb
Sep 30 18:07:35 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb
Sep 30 18:07:35 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:35 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:35 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb" returned: 0 in 0.394s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:35 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb" returned: 0 in 0.449s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ea56b3-5b08-4631-9029-2452950cb721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[171afda8-0ae0-4319-b7e0-83898dd2cd06]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:35 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb
Sep 30 18:07:35 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:35 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721
Sep 30 18:07:35 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:35 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb" returned: 1 in 0.370s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba5b0297-364e-4de0-8d73-ab96ca8d837e_m8o3dlvb' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddeebbc-4c77-4aae-a470-9102570ec9ba]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:36 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD
Sep 30 18:07:36 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:36 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721" returned: 0 in 0.470s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:36 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840
Sep 30 18:07:36 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:36 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:36 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD
Sep 30 18:07:36 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:36 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] ba5b0297-364e-4de0-8d73-ab96ca8d837e was raw, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:07:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:36 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85
Sep 30 18:07:36 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:38 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85" returned: 0 in 1.411s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:38 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba5b0297-364e-4de0-8d73-ab96ca8d837e__jr9egbkdevstack@QuobyteHD, size 0.00 MB, duration 1.41 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:07:38 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 18:07:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:38 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 1G
Sep 30 18:07:38 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:39 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 1G" returned: 0 in 0.903s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Downloaded image ba5b0297-364e-4de0-8d73-ab96ca8d837e ((None, [{'url': 'file:///opt/stack/data/glance/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'metadata': {}}])) to volume 31eec6da-85aa-4e24-9978-71d5d51d8f85 successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Temporary image ba5b0297-364e-4de0-8d73-ab96ca8d837e for user 6a792a4a09e141fd956141b86cb59817 is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Marking volume 31eec6da-85aa-4e24-9978-71d5d51d8f85 as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Copying metadata from image ba5b0297-364e-4de0-8d73-ab96ca8d837e to 31eec6da-85aa-4e24-9978-71d5d51d8f85. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Creating volume glance metadata for volume 31eec6da-85aa-4e24-9978-71d5d51d8f85 backed by image ba5b0297-364e-4de0-8d73-ab96ca8d837e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7efab0d85510c896658053f1d16540cf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694536ec-5c1a-4435-87e5-6ee79e4bb9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31eec6da-85aa-4e24-9978-71d5d51d8f85', 'volume_size': 1, 'image_id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7efab0d85510c896658053f1d16540cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dee19c751c9843988508678e1ec46da1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47b05909c03d3a144f71b4ecd56767618673f3d6768c688ba26228780a6df7dd55dca01e64e31cce349d81e59eca3619c2cd71406804dc3175f8be1510cc67c7', 'id': 'ba5b0297-364e-4de0-8d73-ab96ca8d837e', 'created_at': datetime.datetime(2026, 9, 30, 16, 7, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 7, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba5b0297-364e-4de0-8d73-ab96ca8d837e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c13f48a990>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b21b8a0-a080-446e-b915-b7d1ff4423c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:39 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Volume volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 (31eec6da-85aa-4e24-9978-71d5d51d8f85): created successfully
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b21b8a0-a080-446e-b915-b7d1ff4423c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:39 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Flow 'volume_create_manager' (57db481b-cccd-41da-acf2-1cd8df6929c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2a693637-8652-400d-9d0a-6e62ba668270 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Created volume successfully.
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Acquiring lock "cinder-31eec6da-85aa-4e24-9978-71d5d51d8f85-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "cinder-31eec6da-85aa-4e24-9978-71d5d51d8f85-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Acquiring lock "cinder-quobyte-31eec6da-85aa-4e24-9978-71d5d51d8f85" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "cinder-quobyte-31eec6da-85aa-4e24-9978-71d5d51d8f85" acquired by "delete_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf0deb6-17d4-40c6-a162-e82a39ab7761]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:40 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85
Sep 30 18:07:40 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:40 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85" returned: 0 in 0.644s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:40 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85
Sep 30 18:07:40 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:41 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-31eec6da-85aa-4e24-9978-71d5d51d8f85" returned: 0 in 0.441s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "cinder-quobyte-31eec6da-85aa-4e24-9978-71d5d51d8f85" released by "delete_volume" :: held 1.197s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:41 devstack cinder-volume[87418]: WARNING cinder.quota [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:07:41 devstack cinder-volume[87418]: WARNING cinder.quota [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Created reservations ['19af386d-bca2-4bc8-a024-0f174b8a2c9a', 'ce890f14-72df-49d7-b678-22e01a598409', '6c32892a-932c-45df-8f8d-cebedb9bb806', '7b67d41a-aa4d-4b46-b9f5-6f44b105fa99'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:41 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:41 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:42 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.421s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:42 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Deleted volume successfully.
Sep 30 18:07:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a40e0be8-9fa2-4913-9967-cda8c91ca7e9 tempest-VolumeAndVolumeTypeFromImageTest-1246509666 None] Lock "cinder-31eec6da-85aa-4e24-9978-71d5d51d8f85-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:44 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840" returned: 0 in 8.631s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:44 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:07:44 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Converted 1024.00 MB image at 118.62 MB/s
Sep 30 18:07:44 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 is being set with open permissions: ugo+rw
Sep 30 18:07:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:44 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840
Sep 30 18:07:44 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:45 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840" returned: 0 in 0.286s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-6be5453c-066f-4e3a-a45c-db0b32446840" released by "_copy_volume_from_snapshot" :: held 9.959s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-c0c6c361-605c-413b-ba42-692db16adefb-6be5453c-066f-4e3a-a45c-db0b32446840" released by "_create_volume_from_snapshot" :: held 10.031s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.067s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea639e3-23e4-4d56-b153-70e76b67d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be5453c-066f-4e3a-a45c-db0b32446840', 'volume_size': 1, 'snapshot_id': 'c0c6c361-605c-413b-ba42-692db16adefb'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc34b0f-c644-44de-927d-7d2fb1cf137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:45 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Volume volume-6be5453c-066f-4e3a-a45c-db0b32446840 (6be5453c-066f-4e3a-a45c-db0b32446840): created successfully
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc34b0f-c644-44de-927d-7d2fb1cf137a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Flow 'volume_create_manager' (63d27d69-0709-400d-8441-f428d644353e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:45 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-944680ca-4a3b-476d-84dd-64b3b98947f5 tempest-SnapshotDependencyTests-605115108 None] Created volume successfully.
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-c0c6c361-605c-413b-ba42-692db16adefb-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-c0c6c361-605c-413b-ba42-692db16adefb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-quobyte-33ea56b3-5b08-4631-9029-2452950cb721" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-33ea56b3-5b08-4631-9029-2452950cb721" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-quobyte-c0c6c361-605c-413b-ba42-692db16adefb" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-c0c6c361-605c-413b-ba42-692db16adefb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Deleting offline snapshot c0c6c361-605c-413b-ba42-692db16adefb of volume 33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] snapshot_file for this snap is: volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[861186d9-a03b-4eb2-bc36-c78a90c7880b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:46 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:46 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:46 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb
Sep 30 18:07:46 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:46 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.299s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:07:46 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb" returned: 0 in 0.496s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ea56b3-5b08-4631-9029-2452950cb721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65889c5-afe5-41ec-a2a5-74fe634f51e5]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:47 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721
Sep 30 18:07:47 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:47 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721" returned: 0 in 0.651s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:47 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb
Sep 30 18:07:47 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:47 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb" returned: 0 in 0.351s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:47 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb
Sep 30 18:07:47 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:48 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721.c0c6c361-605c-413b-ba42-692db16adefb" returned: 0 in 0.299s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-c0c6c361-605c-413b-ba42-692db16adefb" released by "_delete_snapshot" :: held 1.940s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-33ea56b3-5b08-4631-9029-2452950cb721" released by "delete_snapshot" :: held 1.974s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Created reservations ['697ca917-b416-4384-910a-3428806e90f8', '5d279b00-f31f-4f3b-9901-4ffbe6c29f34', 'cc3aa100-13e1-46fb-9a29-613eadff43ad', '6475a4f1-1a5b-4210-829a-f4d34c2e093e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (28403b5f-1f2b-4b71-b83f-72b06c595c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e547e8-371e-4ad7-828e-126689abd6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Delete snapshot completed successfully.
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-33ea56b3-5b08-4631-9029-2452950cb721-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f6f02224-c236-4394-8c5c-e64e12ee240a tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-c0c6c361-605c-413b-ba42-692db16adefb-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e547e8-371e-4ad7-828e-126689abd6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451826233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbeec1e-495e-4a61-9699-189efd689be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:48Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2ea109-2420-41fc-82f9-376a823c11b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2ea109-2420-41fc-82f9-376a823c11b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0816605-996f-48d5-965c-8922445dd4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0816605-996f-48d5-965c-8922445dd4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcbeec1e-495e-4a61-9699-189efd689be3', 'volume_name': 'volume-dcbeec1e-495e-4a61-9699-189efd689be3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b022db-e6d8-49be-92dc-bb7527db8931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b022db-e6d8-49be-92dc-bb7527db8931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb980d2-cc18-4142-91e3-fe22a9d52fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Volume dcbeec1e-495e-4a61-9699-189efd689be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcbeec1e-495e-4a61-9699-189efd689be3', 'volume_size': 1}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451826233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbeec1e-495e-4a61-9699-189efd689be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:48Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Creating volume dcbeec1e-495e-4a61-9699-189efd689be3 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:48 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-33ea56b3-5b08-4631-9029-2452950cb721-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:48 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3 1073741824
Sep 30 18:07:48 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-quobyte-33ea56b3-5b08-4631-9029-2452950cb721" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-33ea56b3-5b08-4631-9029-2452950cb721" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81cd94d-4d15-48c1-b2d2-370983f6b9af]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:49 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721
Sep 30 18:07:49 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (2ca25c16-7ba8-43ca-96ef-d9c47d79c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0090eff-ea3f-493b-9e21-4ac5d19eab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0090eff-ea3f-493b-9e21-4ac5d19eab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24841624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075b26e4-18d9-4a9f-b008-f336bcf8dfca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:49Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccd977f-814f-4b92-9e62-f90b57d54f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccd977f-814f-4b92-9e62-f90b57d54f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b6391b-7ae8-4887-858e-5f7fa3948bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b6391b-7ae8-4887-858e-5f7fa3948bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075b26e4-18d9-4a9f-b008-f336bcf8dfca', 'volume_name': 'volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c545a067-4c61-4f6e-9eda-a2abf9be50ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c545a067-4c61-4f6e-9eda-a2abf9be50ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc462f63-d1bc-447a-a07d-94dfa464d00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:49 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Volume 075b26e4-18d9-4a9f-b008-f336bcf8dfca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca', 'volume_size': 1}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:49 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3 1073741824" returned: 0 in 0.658s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:49 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721" returned: 0 in 0.517s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:49 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721
Sep 30 18:07:49 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:49 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3
Sep 30 18:07:49 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:49 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3" returned: 0 in 0.457s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:49 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24841624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075b26e4-18d9-4a9f-b008-f336bcf8dfca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:49Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Creating volume 075b26e4-18d9-4a9f-b008-f336bcf8dfca {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:49 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-33ea56b3-5b08-4631-9029-2452950cb721" returned: 0 in 0.549s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:49 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca 1073741824
Sep 30 18:07:49 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-33ea56b3-5b08-4631-9029-2452950cb721" released by "delete_volume" :: held 1.204s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb980d2-cc18-4142-91e3-fe22a9d52fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbeec1e-495e-4a61-9699-189efd689be3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236b9ce1-0f76-4e67-916b-15e2c67d8bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Volume volume-dcbeec1e-495e-4a61-9699-189efd689be3 (dcbeec1e-495e-4a61-9699-189efd689be3): created successfully
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236b9ce1-0f76-4e67-916b-15e2c67d8bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (28403b5f-1f2b-4b71-b83f-72b06c595c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-138df774-b5e7-4931-a037-5b245d543d3a tempest-CreateVolumesFromImageTest-1046102548 None] Created volume successfully.
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Created reservations ['2ac5a01a-c540-4722-a69b-3d9a36291d3c', 'fa9dfc0e-75ae-45a7-a870-28560f1ffb3f', '65988b2b-825d-4485-b9cc-47dd3eff7d83', 'b99c14f0-b77a-418c-a902-3a5ef1ca90ea'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (4d46ce2a-7fd8-42f3-94e6-ef919114fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e9157e-5e3d-4e97-8339-3e42685558cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e9157e-5e3d-4e97-8339-3e42685558cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765654233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4530ec-88d9-45c9-8e1c-7636dc25ddfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:50Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:50 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b54b71-612c-4757-b5c9-9ad553a9f11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b54b71-612c-4757-b5c9-9ad553a9f11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192af77c-ea1a-48e2-9d77-69bb87576213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192af77c-ea1a-48e2-9d77-69bb87576213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4530ec-88d9-45c9-8e1c-7636dc25ddfd', 'volume_name': 'volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f2d67-cbb7-4770-858b-9c1318ba273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f2d67-cbb7-4770-858b-9c1318ba273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647364c2-129c-4df4-844f-e4fc632ce962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Volume 4b4530ec-88d9-45c9-8e1c-7636dc25ddfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd', 'volume_size': 1}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (117e604a-22b9-4028-b24b-c3d59d7545af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43068439-f323-4d80-8aa7-19cfe8e230f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43068439-f323-4d80-8aa7-19cfe8e230f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-766235655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac1c79c-ee67-4938-b221-c82aec1938e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:50Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e83f27-ae92-4b84-8d81-728fdaac8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e83f27-ae92-4b84-8d81-728fdaac8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ddfa95-858a-4134-b6c2-fdddb946a2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ddfa95-858a-4134-b6c2-fdddb946a2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac1c79c-ee67-4938-b221-c82aec1938e2', 'volume_name': 'volume-dac1c79c-ee67-4938-b221-c82aec1938e2', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3606b5d-564b-42a9-a7be-ef19c42e518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3606b5d-564b-42a9-a7be-ef19c42e518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f10dde-6f28-41e4-89c2-78ffdd5f22a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Volume dac1c79c-ee67-4938-b221-c82aec1938e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac1c79c-ee67-4938-b221-c82aec1938e2', 'volume_size': 1}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:50 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca 1073741824" returned: 0 in 0.790s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:50 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.365s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:50 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:50 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Deleted volume successfully.
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (cc7ca290-c5ad-4a8d-a25a-ba1eca9c3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d5f533-00b6-4e65-a355-936687f6ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fab18862-4f81-4c44-90e9-868a163522c8 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-33ea56b3-5b08-4631-9029-2452950cb721-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d5f533-00b6-4e65-a355-936687f6ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1680324301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa59e61c-c30e-4d65-9784-ed9ecd40502b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:51Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c427415-4767-4158-9650-ad37e6c9593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c427415-4767-4158-9650-ad37e6c9593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0b8e9b-d645-4878-8ad8-b8b5ba469b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0b8e9b-d645-4878-8ad8-b8b5ba469b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa59e61c-c30e-4d65-9784-ed9ecd40502b', 'volume_name': 'volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ae25e3-e37f-4c59-adae-c81a797b70f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ae25e3-e37f-4c59-adae-c81a797b70f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46313b6b-8ff5-459e-a3c2-80c109d12765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Volume aa59e61c-c30e-4d65-9784-ed9ecd40502b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b', 'volume_size': 1}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-6be5453c-066f-4e3a-a45c-db0b32446840-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-6be5453c-066f-4e3a-a45c-db0b32446840-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:50 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765654233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4530ec-88d9-45c9-8e1c-7636dc25ddfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:50Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Creating volume 4b4530ec-88d9-45c9-8e1c-7636dc25ddfd {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:50 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc462f63-d1bc-447a-a07d-94dfa464d00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:51 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd 1073741824
Sep 30 18:07:51 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ea7e6c-02bb-403e-aeed-a47eb6bb8174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:51 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Volume volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca (075b26e4-18d9-4a9f-b008-f336bcf8dfca): created successfully
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ea7e6c-02bb-403e-aeed-a47eb6bb8174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (2ca25c16-7ba8-43ca-96ef-d9c47d79c098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "cinder-quobyte-6be5453c-066f-4e3a-a45c-db0b32446840" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fc3ca78a-0413-4884-a63a-a32ef72dcf8a tempest-CreateVolumesFromImageTest-1046102548 None] Created volume successfully.
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-6be5453c-066f-4e3a-a45c-db0b32446840" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108ccde-4d17-476e-b9d4-d6a0e721c6e8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:51 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840
Sep 30 18:07:51 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:51 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd 1073741824" returned: 0 in 0.461s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:51 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd
Sep 30 18:07:51 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:51 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840" returned: 0 in 0.413s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:51 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840
Sep 30 18:07:51 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:51 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd" returned: 0 in 0.283s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:51 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-766235655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac1c79c-ee67-4938-b221-c82aec1938e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:50Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Creating volume dac1c79c-ee67-4938-b221-c82aec1938e2 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:51 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6be5453c-066f-4e3a-a45c-db0b32446840" returned: 0 in 0.298s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647364c2-129c-4df4-844f-e4fc632ce962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:51 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2 1073741824
Sep 30 18:07:51 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2f814-3bd3-40f3-82ad-1ce4248fdae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-quobyte-6be5453c-066f-4e3a-a45c-db0b32446840" released by "delete_volume" :: held 0.773s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:51 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Volume volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd (4b4530ec-88d9-45c9-8e1c-7636dc25ddfd): created successfully
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2f814-3bd3-40f3-82ad-1ce4248fdae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (4d46ce2a-7fd8-42f3-94e6-ef919114fc86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:51 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c2c980ad-d3ff-42db-b59f-41e8fff1dfc2 tempest-CreateVolumesFromImageTest-1046102548 None] Created volume successfully.
Sep 30 18:07:51 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Created reservations ['426ec1d3-46bb-4ba9-9940-85a111d17b6f', '2f5c3954-4d05-44fe-a5de-ada087ce3908', '125d8761-199a-4b41-85d8-912d05a81195', '0e2a71cf-9dcd-4f60-97ac-a5ea8a600f22'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:52 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:52 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:52 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.275s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Deleted volume successfully.
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-16f1259b-1ec4-4f19-a3e9-260352331784 tempest-SnapshotDependencyTests-605115108 None] Lock "cinder-6be5453c-066f-4e3a-a45c-db0b32446840-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:52 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2 1073741824" returned: 0 in 0.538s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:52 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2
Sep 30 18:07:52 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:52 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1680324301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa59e61c-c30e-4d65-9784-ed9ecd40502b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95f82a07aa492188b89752cdda1062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:07:51Z,use_quota=True,user_id='97722e65a05a4e648d4b8bae7ad6a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Creating volume aa59e61c-c30e-4d65-9784-ed9ecd40502b {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:07:52 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f10dde-6f28-41e4-89c2-78ffdd5f22a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac1c79c-ee67-4938-b221-c82aec1938e2', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:52 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b 1073741824
Sep 30 18:07:52 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ad420e-121a-4d9f-9aab-16d7a6fb1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:52 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Volume volume-dac1c79c-ee67-4938-b221-c82aec1938e2 (dac1c79c-ee67-4938-b221-c82aec1938e2): created successfully
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ad420e-121a-4d9f-9aab-16d7a6fb1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:52 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (117e604a-22b9-4028-b24b-c3d59d7545af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-926dae33-74fd-4b4a-a47e-618ce67b8907 tempest-CreateVolumesFromImageTest-1046102548 None] Created volume successfully.
Sep 30 18:07:53 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b 1073741824" returned: 0 in 0.508s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:53 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b
Sep 30 18:07:53 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:53 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46313b6b-8ff5-459e-a3c2-80c109d12765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b496fe8-1859-4c11-a7b9-310a59256d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:07:53 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Volume volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b (aa59e61c-c30e-4d65-9784-ed9ecd40502b): created successfully
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b496fe8-1859-4c11-a7b9-310a59256d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:07:53 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Flow 'volume_create_manager' (cc7ca290-c5ad-4a8d-a25a-ba1eca9c3147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:07:53 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c34bf7d2-428c-4c6a-8252-ac1dd505a3ca tempest-CreateVolumesFromImageTest-1046102548 None] Created volume successfully.
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-aa59e61c-c30e-4d65-9784-ed9ecd40502b-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-aa59e61c-c30e-4d65-9784-ed9ecd40502b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-quobyte-aa59e61c-c30e-4d65-9784-ed9ecd40502b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-aa59e61c-c30e-4d65-9784-ed9ecd40502b" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde471f6-eb6f-444b-a157-4847107c4cd0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:54 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b
Sep 30 18:07:54 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:54 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b" returned: 0 in 0.410s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:54 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b
Sep 30 18:07:54 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:55 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-aa59e61c-c30e-4d65-9784-ed9ecd40502b" returned: 0 in 0.244s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-aa59e61c-c30e-4d65-9784-ed9ecd40502b" released by "delete_volume" :: held 0.700s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Created reservations ['385e15f6-1c8d-4cd6-9d35-ee99222163e5', '509995a0-e64c-498b-a2fb-e9f7e1de2dda', 'e34deab9-22cb-4234-81d4-cc6ae10ece59', 'ad2531f3-efec-4861-adac-52f456b851ee'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:55 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:55 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:55 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Deleted volume successfully.
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fe79edfe-7bae-4afa-8c47-108e0143e996 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-aa59e61c-c30e-4d65-9784-ed9ecd40502b-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-dac1c79c-ee67-4938-b221-c82aec1938e2-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-dac1c79c-ee67-4938-b221-c82aec1938e2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-quobyte-dac1c79c-ee67-4938-b221-c82aec1938e2" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-dac1c79c-ee67-4938-b221-c82aec1938e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2055e0b-8b47-4550-872b-ad5987077d52]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:55 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2
Sep 30 18:07:55 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:55 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2" returned: 0 in 0.431s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:55 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2
Sep 30 18:07:55 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:56 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dac1c79c-ee67-4938-b221-c82aec1938e2" returned: 0 in 0.252s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-dac1c79c-ee67-4938-b221-c82aec1938e2" released by "delete_volume" :: held 0.743s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Created reservations ['774a5da0-3bd1-406a-8bc5-1f654f981441', 'af0d62b6-4a0c-4204-85b0-69f5ddfab4f8', '2820df8c-b60b-4581-b0c8-1bd26a8e1a39', 'dbbcf8b8-c818-430d-828e-632f7aad036c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:56 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:56 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:56 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.273s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Deleted volume successfully.
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-371acede-3a36-431a-87ca-bc162eaf6e7e tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-dac1c79c-ee67-4938-b221-c82aec1938e2-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-quobyte-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd" acquired by "delete_volume" :: waited 0.013s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6cbb58-38b9-4e5d-9f95-d2a1d6c157ec]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:56 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd
Sep 30 18:07:56 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:57 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd" returned: 0 in 0.368s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:57 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd
Sep 30 18:07:57 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:57 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd" returned: 0 in 0.363s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd" released by "delete_volume" :: held 0.779s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Created reservations ['ebf6490a-72a9-4f9a-93d6-0d396e8f4b88', '74d7db84-36f9-4892-af3b-3a3f4288330a', '17d23f1b-a871-4244-876e-7ca65b506c46', '84d781d3-d68d-4802-9e96-13197cb8db72'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:57 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:57 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-075b26e4-18d9-4a9f-b008-f336bcf8dfca-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-075b26e4-18d9-4a9f-b008-f336bcf8dfca-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:57 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-quobyte-075b26e4-18d9-4a9f-b008-f336bcf8dfca" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-075b26e4-18d9-4a9f-b008-f336bcf8dfca" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96144ecf-f877-41cf-bc92-969b3ce12f19]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:58 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Deleted volume successfully.
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-036b5506-ae3c-4093-ac24-6734d4e02c7f tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-4b4530ec-88d9-45c9-8e1c-7636dc25ddfd-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:58 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca
Sep 30 18:07:58 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:58 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca" returned: 0 in 0.512s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:58 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca
Sep 30 18:07:58 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:58 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-075b26e4-18d9-4a9f-b008-f336bcf8dfca" returned: 0 in 0.277s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-075b26e4-18d9-4a9f-b008-f336bcf8dfca" released by "delete_volume" :: held 0.847s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Created reservations ['06cfd7eb-10e7-4d9f-990f-643cd894feee', '83c03280-f739-4ecd-b453-e0bc0abd93f6', '2c2081f9-a795-4405-adee-b6cbe257ac55', '54cf649e-2969-4ef1-9394-d4f8166f8eba'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:07:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:59 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:07:59 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-dcbeec1e-495e-4a61-9699-189efd689be3-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-dcbeec1e-495e-4a61-9699-189efd689be3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "cinder-quobyte-dcbeec1e-495e-4a61-9699-189efd689be3" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-dcbeec1e-495e-4a61-9699-189efd689be3" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d479e401-64db-464b-8d2f-8e7889aaf43c]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:59 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.297s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:07:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Deleted volume successfully.
Sep 30 18:07:59 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3
Sep 30 18:07:59 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-b9c3001a-265c-40fe-8cf1-0e63224ae5c7 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-075b26e4-18d9-4a9f-b008-f336bcf8dfca-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:59 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3" returned: 0 in 0.404s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:07:59 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3
Sep 30 18:07:59 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:07:59 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dcbeec1e-495e-4a61-9699-189efd689be3" returned: 0 in 0.241s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-quobyte-dcbeec1e-495e-4a61-9699-189efd689be3" released by "delete_volume" :: held 0.692s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:07:59 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Created reservations ['5c2ab501-9873-4103-aff3-e27db7c12367', '58626739-e909-426a-8ec5-b366bde1f728', '6f7143bf-4394-45a3-b4e7-d918d38c6e0c', 'b7cc6ccb-1f47-495f-b4fd-d3dbe0ca3e84'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:00 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:08:00 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:00 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:08:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Deleted volume successfully.
Sep 30 18:08:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-65a4ac44-56e2-476e-baec-4f530c7c4362 tempest-CreateVolumesFromImageTest-1046102548 None] Lock "cinder-dcbeec1e-495e-4a61-9699-189efd689be3-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Flow 'volume_create_manager' (45456557-6734-4b46-9e35-828311b269e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9deddc2-c98c-4279-9ef0-32ec1569096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9deddc2-c98c-4279-9ef0-32ec1569096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4529d4eb-3010-433b-a8f4-5fad1df604d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9216921118c4836b0dc7b1a17867a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:08:04Z,use_quota=True,user_id='595bfb4b620a49ae8dd654661c0fd18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec6a28a-f490-4181-920f-5d0385c3964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec6a28a-f490-4181-920f-5d0385c3964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183ab10d-1ca6-4564-8681-32d00dcf939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183ab10d-1ca6-4564-8681-32d00dcf939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4529d4eb-3010-433b-a8f4-5fad1df604d7', 'volume_name': 'volume-4529d4eb-3010-433b-a8f4-5fad1df604d7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fc110d-668c-414c-8b36-1828dfe2cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fc110d-668c-414c-8b36-1828dfe2cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ede7c5c-9b00-40c1-893a-6e293cd90267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:03 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Volume 4529d4eb-3010-433b-a8f4-5fad1df604d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4529d4eb-3010-433b-a8f4-5fad1df604d7', 'volume_size': 1}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4529d4eb-3010-433b-a8f4-5fad1df604d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9216921118c4836b0dc7b1a17867a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:08:04Z,use_quota=True,user_id='595bfb4b620a49ae8dd654661c0fd18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Creating volume 4529d4eb-3010-433b-a8f4-5fad1df604d7 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:08:03 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:08:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:03 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 1073741824
Sep 30 18:08:03 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:04 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 1073741824" returned: 0 in 0.404s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:04 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7
Sep 30 18:08:04 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:04 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ede7c5c-9b00-40c1-893a-6e293cd90267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4529d4eb-3010-433b-a8f4-5fad1df604d7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197bc14c-8abf-41f8-b637-217e42eba677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:04 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Volume volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 (4529d4eb-3010-433b-a8f4-5fad1df604d7): created successfully
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197bc14c-8abf-41f8-b637-217e42eba677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Flow 'volume_create_manager' (45456557-6734-4b46-9e35-828311b269e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:08:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-94f94810-0d67-4880-9ef0-052049d4d674 tempest-CinderUnicodeTest-929711467 None] Created volume successfully.
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Flow 'volume_create_manager' (4b8b4d14-6874-4041-9cd6-ddcc9f2b55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d633d7-802b-4f41-9de6-a5ffad490347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d633d7-802b-4f41-9de6-a5ffad490347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:08:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1698019103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c20bb3-b2d5-4933-9e1b-a75779870cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9216921118c4836b0dc7b1a17867a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:08:05Z,use_quota=True,user_id='595bfb4b620a49ae8dd654661c0fd18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258b770a-e358-4a55-ad6f-818254544a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258b770a-e358-4a55-ad6f-818254544a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b202959e-3ef5-43fb-9c48-1905d60ab770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b202959e-3ef5-43fb-9c48-1905d60ab770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c20bb3-b2d5-4933-9e1b-a75779870cce', 'volume_name': 'volume-65c20bb3-b2d5-4933-9e1b-a75779870cce', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842c648f-e8ad-4bb8-a0de-003916bfa933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842c648f-e8ad-4bb8-a0de-003916bfa933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35864ca4-5a20-4524-89bc-cfc87dcef488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Volume 65c20bb3-b2d5-4933-9e1b-a75779870cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c20bb3-b2d5-4933-9e1b-a75779870cce', 'volume_size': 1}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:08:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1698019103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c20bb3-b2d5-4933-9e1b-a75779870cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9216921118c4836b0dc7b1a17867a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:08:05Z,use_quota=True,user_id='595bfb4b620a49ae8dd654661c0fd18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Creating volume 65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:08:05 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:05 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce 1073741824
Sep 30 18:08:05 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:05 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce 1073741824" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:05 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce
Sep 30 18:08:05 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:05 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce" returned: 0 in 0.244s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35864ca4-5a20-4524-89bc-cfc87dcef488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c20bb3-b2d5-4933-9e1b-a75779870cce', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff801aa-61d7-490e-a67e-8f699643e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Volume volume-65c20bb3-b2d5-4933-9e1b-a75779870cce (65c20bb3-b2d5-4933-9e1b-a75779870cce): created successfully
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff801aa-61d7-490e-a67e-8f699643e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Flow 'volume_create_manager' (4b8b4d14-6874-4041-9cd6-ddcc9f2b55d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:08:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-540969bc-982d-4a63-b17b-2a163ee4540e tempest-CinderUnicodeTest-929711467 None] Created volume successfully.
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Creating offline snapshot e58f6691-59eb-40ea-94c9-78caf6b93d56 of volume 65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ab15d9-43ce-4ecc-bbb5-483ac33e9144]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:06 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce
Sep 30 18:08:06 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:06 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce" returned: 0 in 0.348s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:06 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 1G
Sep 30 18:08:06 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:07 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 1G" returned: 0 in 0.392s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c20bb3-b2d5-4933-9e1b-a75779870cce -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:07 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c20bb3-b2d5-4933-9e1b-a75779870cce -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56
Sep 30 18:08:07 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:07 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c20bb3-b2d5-4933-9e1b-a75779870cce -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56" returned: 0 in 0.296s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:07 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 is being set with open permissions: ugo+rw
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:07 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56
Sep 30 18:08:07 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:07 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:07 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info
Sep 30 18:08:07 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:07 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info" returned: 0 in 0.243s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:07 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info is being set with open permissions: ugo+rw
Sep 30 18:08:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:08 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info
Sep 30 18:08:08 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:08 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.info" returned: 0 in 0.235s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-98f4863e-720f-49a1-8fe9-9d7b17282026 tempest-CinderUnicodeTest-929711467 None] Create snapshot completed successfully
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-e58f6691-59eb-40ea-94c9-78caf6b93d56-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Lock "cinder-e58f6691-59eb-40ea-94c9-78caf6b93d56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-quobyte-65c20bb3-b2d5-4933-9e1b-a75779870cce" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-65c20bb3-b2d5-4933-9e1b-a75779870cce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-quobyte-e58f6691-59eb-40ea-94c9-78caf6b93d56" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-e58f6691-59eb-40ea-94c9-78caf6b93d56" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Deleting offline snapshot e58f6691-59eb-40ea-94c9-78caf6b93d56 of volume 65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] snapshot_file for this snap is: volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a0d60-1c39-4ce1-831b-04202a91cc14]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:08 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56
Sep 30 18:08:08 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:09 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56" returned: 0 in 0.352s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65c20bb3-b2d5-4933-9e1b-a75779870cce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b8450c-4d13-49fa-8cfc-a226399b8322]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:09 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce
Sep 30 18:08:09 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:09 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:09 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56
Sep 30 18:08:09 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:09 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56" returned: 0 in 0.318s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:09 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56
Sep 30 18:08:09 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:10 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce.e58f6691-59eb-40ea-94c9-78caf6b93d56" returned: 0 in 0.236s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-e58f6691-59eb-40ea-94c9-78caf6b93d56" released by "_delete_snapshot" :: held 1.360s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-65c20bb3-b2d5-4933-9e1b-a75779870cce" released by "delete_snapshot" :: held 1.382s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Created reservations ['d6c01ae2-ff49-439b-8c15-55ab89320d80', '87073792-0d41-4285-a957-f24535809b73', 'ca600c2f-06ff-48a8-a353-4351884e67d5', '4ed34e78-f56a-4a8f-9d25-874014a4130b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:08:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Delete snapshot completed successfully.
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e143799e-1506-4e81-be20-28c4e07011ec tempest-CinderUnicodeTest-929711467 None] Lock "cinder-e58f6691-59eb-40ea-94c9-78caf6b93d56-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-65c20bb3-b2d5-4933-9e1b-a75779870cce-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-65c20bb3-b2d5-4933-9e1b-a75779870cce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-quobyte-65c20bb3-b2d5-4933-9e1b-a75779870cce" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-65c20bb3-b2d5-4933-9e1b-a75779870cce" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f7431c-5cf1-4b6b-b6db-5c23941b7699]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:11 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce
Sep 30 18:08:11 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:11 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce" returned: 0 in 0.375s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:11 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce
Sep 30 18:08:11 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:11 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-65c20bb3-b2d5-4933-9e1b-a75779870cce" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-65c20bb3-b2d5-4933-9e1b-a75779870cce" released by "delete_volume" :: held 0.734s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Created reservations ['bf1354a1-e740-41e1-b186-d25e88404637', '017d49ff-6f80-464b-b73e-f4aebc798111', '982f6dca-67ef-4ea2-9a41-91fc71b96f65', '1a76b04d-64b7-4024-9f81-f801eb3c150b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:11 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:08:11 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-4529d4eb-3010-433b-a8f4-5fad1df604d7-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-4529d4eb-3010-433b-a8f4-5fad1df604d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "cinder-quobyte-4529d4eb-3010-433b-a8f4-5fad1df604d7" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-4529d4eb-3010-433b-a8f4-5fad1df604d7" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:12 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.416s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:08:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Deleted volume successfully.
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eb930c-dff3-4653-beff-9519b0562f63]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e07b5d34-b715-4eba-a1fa-d9a80ba33860 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-65c20bb3-b2d5-4933-9e1b-a75779870cce-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:12 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7
Sep 30 18:08:12 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:12 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7" returned: 0 in 0.548s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:12 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7
Sep 30 18:08:12 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:13 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4529d4eb-3010-433b-a8f4-5fad1df604d7" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-quobyte-4529d4eb-3010-433b-a8f4-5fad1df604d7" released by "delete_volume" :: held 0.878s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Created reservations ['91250848-d65c-4823-b450-042d27f9c9b8', 'd53ff2a6-b449-4b81-81b9-bb73b09216f7', '0f4885f9-f123-42ce-87fc-9cfa1ddb4260', '24182d1b-2f0b-41af-8876-45e1a5034625'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:13 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:08:13 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:13 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:08:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Deleted volume successfully.
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a168d1bb-e579-47a6-b5c6-d93dc91113f3 tempest-CinderUnicodeTest-929711467 None] Lock "cinder-4529d4eb-3010-433b-a8f4-5fad1df604d7-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-7bb1415c-dac3-42fb-a351-02fae2a27b51 tempest-TestShelveInstance-1006687766 None] Terminate volume connection completed successfully.
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-7bb1415c-dac3-42fb-a351-02fae2a27b51 tempest-TestShelveInstance-1006687766 None] Deleting attachment cc579e84-b6df-4643-8f15-69175cd4fc05. {{(pid=87418) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Acquiring lock "cinder-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Lock "cinder-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Acquiring lock "cinder-quobyte-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Lock "cinder-quobyte-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ea6236-0696-4f9a-9a72-842588d0ca27]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:14 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f
Sep 30 18:08:14 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:14 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" returned: 0 in 0.421s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:14 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f
Sep 30 18:08:14 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:14 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" returned: 0 in 0.295s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Lock "cinder-quobyte-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f" released by "delete_volume" :: held 0.768s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG cinder.quota [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Created reservations ['231c3e69-4eb2-4ed8-b9dc-e2dda571f8c5', 'ad0fcfa6-54fb-4cd3-8aea-4c48738acd81', '431bd0cb-5919-41ef-b090-d213b0eb646d', 'b61fe7d0-85cf-4a4f-8406-fb4647399b0b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:15 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:08:15 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:15 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.297s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:15 devstack cinder-volume[87418]: DEBUG cinder.manager [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:08:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Deleted volume successfully.
Sep 30 18:08:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [req-cef67020-7444-4d41-b0ac-28a6a6303d3f req-accb82f5-11d6-49f3-944c-325aae45d8af tempest-TestShelveInstance-1006687766 None] Lock "cinder-ac1adf5c-fad2-4d11-a2cf-5a7f958e625f-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:08:24 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=107,cinder:UPDATE=140,cinder:INSERT=35,cinder:DELETE=15 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:08:25 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=111,cinder:UPDATE=130,cinder:INSERT=39,cinder:DELETE=8 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Flow 'volume_create_manager' (23ff3354-d081-4f51-bc04-57dbdb5b0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b19bc63-62eb-4f0a-8785-b37f1684a2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b19bc63-62eb-4f0a-8785-b37f1684a2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1443015143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9dd7c713c2415abaa145c6939a7a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:08:45Z,use_quota=True,user_id='f736718618cf4ab4bb55f6dc6b883286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f92577f-d1cb-4557-81d3-532750f604d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f92577f-d1cb-4557-81d3-532750f604d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae6c742-7355-4de7-b368-628264328a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae6c742-7355-4de7-b368-628264328a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8', 'volume_name': 'volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ca24a7-06df-4a6c-bd85-ff49e2d211fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ca24a7-06df-4a6c-bd85-ff49e2d211fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88fac3c-b4fd-4cf1-8b02-371361f30394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:44 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Volume c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8', 'volume_size': 1}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1443015143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9dd7c713c2415abaa145c6939a7a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:08:45Z,use_quota=True,user_id='f736718618cf4ab4bb55f6dc6b883286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Creating volume c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:08:44 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:08:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:44 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 1073741824
Sep 30 18:08:44 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:45 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 1073741824" returned: 0 in 0.398s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:45 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8
Sep 30 18:08:45 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:45 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" returned: 0 in 0.241s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88fac3c-b4fd-4cf1-8b02-371361f30394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2231909-22bb-4d5b-9847-dd7d57b60459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:08:45 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Volume volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 (c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8): created successfully
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2231909-22bb-4d5b-9847-dd7d57b60459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:08:45 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Flow 'volume_create_manager' (23ff3354-d081-4f51-bc04-57dbdb5b0a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:08:45 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e940a334-a954-4e1e-861f-24022b9590d6 tempest-TestImageHashVerification-91301307 None] Created volume successfully.
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:46 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:08:46 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688f9e3-61a2-48be-bee1-08d0e8830cba]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:46 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8
Sep 30 18:08:46 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:46 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:08:46 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" returned: 0 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bf06be-36ce-4962-96f2-e0575ff351c6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:46 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8
Sep 30 18:08:46 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:47 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" returned: 0 in 0.349s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 /opt/stack/data/cinder/conversion/c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8.temp_image.1749b659-dfd7-48c8-b48c-920b75429e69lk9mc5bu.img {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:47 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 /opt/stack/data/cinder/conversion/c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8.temp_image.1749b659-dfd7-48c8-b48c-920b75429e69lk9mc5bu.img
Sep 30 18:08:47 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:52 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 /opt/stack/data/cinder/conversion/c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8.temp_image.1749b659-dfd7-48c8-b48c-920b75429e69lk9mc5bu.img" returned: 0 in 5.650s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db038f5-8596-4640-88cc-978cdb914351]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:08:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:08:52 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8
Sep 30 18:08:52 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:08:53 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Sep 30 18:08:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" returned: 0 in 0.527s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:08:53 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/conversion/c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8.temp_image.1749b659-dfd7-48c8-b48c-920b75429e69lk9mc5bu.img {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:08:53 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Converted 1024.00 MB image at 181.20 MB/s
Sep 30 18:08:53 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] 1749b659-dfd7-48c8-b48c-920b75429e69 was raw, no need to convert to raw {{(pid=87418) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 30 18:09:03 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:09:03 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.634s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Uploaded volume to glance image-id: 1749b659-dfd7-48c8-b48c-920b75429e69. {{(pid=87418) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 30 18:09:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3736a0d2-11e6-4db1-9b78-2a06b80ffdcd tempest-TestImageHashVerification-91301307 None] Copy volume to image completed successfully.
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Acquiring lock "cinder-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Lock "cinder-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Acquiring lock "cinder-quobyte-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Lock "cinder-quobyte-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" acquired by "delete_volume" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8764a11-b19a-41a4-a859-334965be2462]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:13 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8
Sep 30 18:09:13 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:13 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" returned: 0 in 0.351s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:13 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8
Sep 30 18:09:13 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:13 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" returned: 0 in 0.244s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Lock "cinder-quobyte-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8" released by "delete_volume" :: held 0.633s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Created reservations ['9b7a49cd-2152-4b3e-b0c9-624fd67378e1', '2f7bb4b7-9cb0-4d22-9577-7ffb6eae2043', '9cd01a1b-947c-4e57-bc6a-1cce47713b11', '2a021bd0-085f-4855-91a2-dfe082d0df85'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:13 devstack sudo[106810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:13 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:13 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Deleted volume successfully.
Sep 30 18:09:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-814d333e-9da6-45e1-85f2-256a23dba9ed tempest-TestImageHashVerification-91301307 None] Lock "cinder-c4a63e2e-9cfb-4b7e-b51b-a35230e9e1a8-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:23 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:09:23 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (cb736960-a010-417e-9525-ce0464ed6156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c76fcb-b440-4099-87c9-10fb250c2ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c76fcb-b440-4099-87c9-10fb250c2ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789357828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:26Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3edb13-7b8a-4890-ae46-9dfdb65aa30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3edb13-7b8a-4890-ae46-9dfdb65aa30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eced6604-4bc6-464f-8002-8fcf2ffa5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eced6604-4bc6-464f-8002-8fcf2ffa5b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c', 'volume_name': 'volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016e4b38-61f7-45d0-8504-669f9f12beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016e4b38-61f7-45d0-8504-669f9f12beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e03390-a5b8-478c-b563-36c0821c5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:25 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume 98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c', 'volume_size': 1}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789357828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:26Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Creating volume 98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:25 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:25 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c 1073741824
Sep 30 18:09:25 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:26 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c 1073741824" returned: 0 in 0.407s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:26 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c
Sep 30 18:09:26 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:26 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c" returned: 0 in 0.239s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e03390-a5b8-478c-b563-36c0821c5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcae4a8d-8591-400a-8351-90b9bac5336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c (98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c): created successfully
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcae4a8d-8591-400a-8351-90b9bac5336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (cb736960-a010-417e-9525-ce0464ed6156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b5c38e44-d9ba-4320-a4ce-fae4f2076432 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created volume successfully.
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (43bc6d60-be9f-40ea-a5ce-6a875052b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b576b-0d72-48d2-9767-928ee5574756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b576b-0d72-48d2-9767-928ee5574756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-661250485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ffbc7-c89e-4880-82f4-bc549317624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:27Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dc31c5-1284-45aa-821c-cf12f558d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dc31c5-1284-45aa-821c-cf12f558d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93bbc2c-e907-40fd-ad1e-b74185a08fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93bbc2c-e907-40fd-ad1e-b74185a08fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4ffbc7-c89e-4880-82f4-bc549317624c', 'volume_name': 'volume-3a4ffbc7-c89e-4880-82f4-bc549317624c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da66e24e-3a0c-488c-a55a-e1c7a512303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da66e24e-3a0c-488c-a55a-e1c7a512303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca23414-68b1-4f64-b5e2-d67218aba1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume 3a4ffbc7-c89e-4880-82f4-bc549317624c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4ffbc7-c89e-4880-82f4-bc549317624c', 'volume_size': 1}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-661250485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ffbc7-c89e-4880-82f4-bc549317624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:27Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Creating volume 3a4ffbc7-c89e-4880-82f4-bc549317624c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:27 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:27 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c 1073741824
Sep 30 18:09:27 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (f2c5a313-8ca5-4748-991f-112899dbcb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8ce8aa-ec84-4fd7-9a26-a5664e10c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8ce8aa-ec84-4fd7-9a26-a5664e10c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61227966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fee8c6-417e-4b37-bf67-08edc604d9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:28Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4810183a-47c5-4675-aed1-6d63fac2d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4810183a-47c5-4675-aed1-6d63fac2d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275f605a-e4eb-43cf-9357-f89597a5fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275f605a-e4eb-43cf-9357-f89597a5fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40fee8c6-417e-4b37-bf67-08edc604d9a9', 'volume_name': 'volume-40fee8c6-417e-4b37-bf67-08edc604d9a9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89329a8b-559e-434f-8d77-679c2c2d6b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89329a8b-559e-434f-8d77-679c2c2d6b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9f41af-0b6d-421f-800e-e75bdf5b1da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume 40fee8c6-417e-4b37-bf67-08edc604d9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40fee8c6-417e-4b37-bf67-08edc604d9a9', 'volume_size': 1}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:27 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c 1073741824" returned: 0 in 0.501s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:27 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c
Sep 30 18:09:27 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (2ae2daed-17b0-41a7-aff2-b027c437cb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c69f4f-2f97-42e3-9708-4c48e3f2f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c69f4f-2f97-42e3-9708-4c48e3f2f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974270856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fe3601-7d3f-48cc-b9d6-26d254685626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:28Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2ce721-aa3b-4642-a2fb-c65fc3c99dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2ce721-aa3b-4642-a2fb-c65fc3c99dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b1e8b1-984b-4ec8-816b-45f2323af5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b1e8b1-984b-4ec8-816b-45f2323af5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fe3601-7d3f-48cc-b9d6-26d254685626', 'volume_name': 'volume-38fe3601-7d3f-48cc-b9d6-26d254685626', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060248bd-354b-47f5-81a6-adcf64c89c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060248bd-354b-47f5-81a6-adcf64c89c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db820757-4f6f-4a3c-b743-e8a9ca1b7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume 38fe3601-7d3f-48cc-b9d6-26d254685626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fe3601-7d3f-48cc-b9d6-26d254685626', 'volume_size': 1}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:28 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61227966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fee8c6-417e-4b37-bf67-08edc604d9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:28Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Creating volume 40fee8c6-417e-4b37-bf67-08edc604d9a9 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca23414-68b1-4f64-b5e2-d67218aba1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4ffbc7-c89e-4880-82f4-bc549317624c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e775b1d-5677-495e-915b-90b4ffd9a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 1073741824
Sep 30 18:09:28 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume volume-3a4ffbc7-c89e-4880-82f4-bc549317624c (3a4ffbc7-c89e-4880-82f4-bc549317624c): created successfully
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e775b1d-5677-495e-915b-90b4ffd9a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (43bc6d60-be9f-40ea-a5ce-6a875052b836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-091a760a-34e0-41e8-ae03-70f452784b0a tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created volume successfully.
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (a83552ea-926e-4fdc-ad71-2dee100a154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2cb779-3d8d-45ae-b0ac-fc87be49f1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2cb779-3d8d-45ae-b0ac-fc87be49f1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152857666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69007e9b-7890-4820-91c9-fff011a97635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:28Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb68dd-8c54-436b-91d8-5771fbaba7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb68dd-8c54-436b-91d8-5771fbaba7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df754c19-7c2b-426e-bc29-8772df9d3d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df754c19-7c2b-426e-bc29-8772df9d3d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69007e9b-7890-4820-91c9-fff011a97635', 'volume_name': 'volume-69007e9b-7890-4820-91c9-fff011a97635', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea36101-60f8-4c60-981c-734d42344868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea36101-60f8-4c60-981c-734d42344868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2f4873-3572-4601-be3a-3d6b9763b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume 69007e9b-7890-4820-91c9-fff011a97635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69007e9b-7890-4820-91c9-fff011a97635', 'volume_size': 1}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:28 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 1073741824" returned: 0 in 0.506s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:28 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9
Sep 30 18:09:28 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (169b3d3b-47ee-4e1f-8841-50d8a2e22635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10342212-c547-481d-8ac0-fa1874b6b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10342212-c547-481d-8ac0-fa1874b6b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165089860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0b39d3-1e03-48ea-94cb-7baaf8bf19da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:29Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8898f1e-d1c3-401d-af32-6ef38b85230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8898f1e-d1c3-401d-af32-6ef38b85230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82428218-f986-4bd3-b81f-002a94f55c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82428218-f986-4bd3-b81f-002a94f55c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0b39d3-1e03-48ea-94cb-7baaf8bf19da', 'volume_name': 'volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2521dc4a-4d49-4b08-937b-cc3521666ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2521dc4a-4d49-4b08-937b-cc3521666ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fcf209-91e2-4a04-9426-c06bc8a086b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume 0e0b39d3-1e03-48ea-94cb-7baaf8bf19da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da', 'volume_size': 1}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:28 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974270856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fe3601-7d3f-48cc-b9d6-26d254685626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:28Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Creating volume 38fe3601-7d3f-48cc-b9d6-26d254685626 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9f41af-0b6d-421f-800e-e75bdf5b1da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fee8c6-417e-4b37-bf67-08edc604d9a9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:28 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626 1073741824
Sep 30 18:09:28 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc92f41-0f43-46ad-8459-08c3255859f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 (40fee8c6-417e-4b37-bf67-08edc604d9a9): created successfully
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc92f41-0f43-46ad-8459-08c3255859f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (f2c5a313-8ca5-4748-991f-112899dbcb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-aa3579be-b81d-4010-94c0-3b0d06a3fb9d tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created volume successfully.
Sep 30 18:09:29 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626 1073741824" returned: 0 in 0.402s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:29 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626
Sep 30 18:09:29 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:29 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626" returned: 0 in 0.235s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152857666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69007e9b-7890-4820-91c9-fff011a97635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:28Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Creating volume 69007e9b-7890-4820-91c9-fff011a97635 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:29 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db820757-4f6f-4a3c-b743-e8a9ca1b7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fe3601-7d3f-48cc-b9d6-26d254685626', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:29 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635 1073741824
Sep 30 18:09:29 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6b0a4-bde1-41d0-951f-a38b499be4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:29 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume volume-38fe3601-7d3f-48cc-b9d6-26d254685626 (38fe3601-7d3f-48cc-b9d6-26d254685626): created successfully
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6b0a4-bde1-41d0-951f-a38b499be4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (2ae2daed-17b0-41a7-aff2-b027c437cb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-44ca0acf-7f36-42d0-842e-eb66bb38b195 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created volume successfully.
Sep 30 18:09:30 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635 1073741824" returned: 0 in 0.411s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:30 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635
Sep 30 18:09:30 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:30 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635" returned: 0 in 0.237s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165089860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0b39d3-1e03-48ea-94cb-7baaf8bf19da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579f90b9dab04e84a3ab70e7367b1b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:29Z,use_quota=True,user_id='80d3cccdc50e4978891a15f2a0ec5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Creating volume 0e0b39d3-1e03-48ea-94cb-7baaf8bf19da {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:30 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2f4873-3572-4601-be3a-3d6b9763b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69007e9b-7890-4820-91c9-fff011a97635', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:30 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da 1073741824
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11acf89-8f5d-4875-81c4-de036e535730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:30 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:30 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume volume-69007e9b-7890-4820-91c9-fff011a97635 (69007e9b-7890-4820-91c9-fff011a97635): created successfully
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11acf89-8f5d-4875-81c4-de036e535730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (a83552ea-926e-4fdc-ad71-2dee100a154a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-317387bf-ee86-4c98-ac4d-2858611fa785 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created volume successfully.
Sep 30 18:09:30 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da 1073741824" returned: 0 in 0.405s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:30 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da
Sep 30 18:09:30 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:30 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fcf209-91e2-4a04-9426-c06bc8a086b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1c53b6-2924-472f-b324-d837fab4a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Volume volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da (0e0b39d3-1e03-48ea-94cb-7baaf8bf19da): created successfully
Sep 30 18:09:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1c53b6-2924-472f-b324-d837fab4a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Flow 'volume_create_manager' (169b3d3b-47ee-4e1f-8841-50d8a2e22635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-acde39fc-7d37-4514-8fb6-eeb32110b117 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created volume successfully.
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-quobyte-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f63196-6633-42f1-8724-5d473f452c71]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:32 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da
Sep 30 18:09:32 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:32 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:32 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da
Sep 30 18:09:32 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:32 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da" released by "delete_volume" :: held 0.627s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created reservations ['bd786b41-5f68-4b5f-a22f-add0d5cde35a', 'ab67fc9a-9764-4370-9cdb-b935b09f6b35', 'ba60d082-5b33-4ed5-b776-c51f7a891d47', '46dfc74c-aba0-4ea3-88c1-807ad9c893a8'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:32 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:32 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:33 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.229s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Deleted volume successfully.
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a43de7e1-d96a-4bcc-b486-b4f67c714e12 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-0e0b39d3-1e03-48ea-94cb-7baaf8bf19da-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-69007e9b-7890-4820-91c9-fff011a97635-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-69007e9b-7890-4820-91c9-fff011a97635-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-quobyte-69007e9b-7890-4820-91c9-fff011a97635" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-69007e9b-7890-4820-91c9-fff011a97635" acquired by "delete_volume" :: waited 0.013s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa07f7d-cc72-4b66-b0c6-347901cb5715]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:33 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635
Sep 30 18:09:33 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:33 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635" returned: 0 in 0.340s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:33 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635
Sep 30 18:09:33 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:33 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-69007e9b-7890-4820-91c9-fff011a97635" returned: 0 in 0.234s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-69007e9b-7890-4820-91c9-fff011a97635" released by "delete_volume" :: held 0.614s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created reservations ['6d39bd06-49b1-42c5-b9a0-e9531f30e084', '60884684-8950-4f58-a5db-0941564cd683', '1aeb4fa4-b396-469a-9411-5bece428366e', '24fe7b8e-655b-4407-906d-b019183a1fc4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:34 devstack sudo[106894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:34 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:34 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.241s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Deleted volume successfully.
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8c38c6f2-5c51-44e1-b809-9fc01bfcf7cf tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-69007e9b-7890-4820-91c9-fff011a97635-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-38fe3601-7d3f-48cc-b9d6-26d254685626-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-38fe3601-7d3f-48cc-b9d6-26d254685626-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-quobyte-38fe3601-7d3f-48cc-b9d6-26d254685626" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-38fe3601-7d3f-48cc-b9d6-26d254685626" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf511fe-836e-4bb9-92b9-a7d49b94b541]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:34 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626
Sep 30 18:09:34 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:34 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626" returned: 0 in 0.354s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:34 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626
Sep 30 18:09:34 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:35 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38fe3601-7d3f-48cc-b9d6-26d254685626" returned: 0 in 0.232s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-38fe3601-7d3f-48cc-b9d6-26d254685626" released by "delete_volume" :: held 0.626s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created reservations ['546a8040-09f9-4ebb-8f8b-bdcd6607c98c', '7c85d752-b6d6-4a5f-97fe-a9ca6512653d', '7d2bb039-7d01-4112-9104-b5bdffdac2ee', '60e565e4-f6bb-40b0-b744-0f9f488f4e08'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:35 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:35 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:35 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.239s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:35 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Deleted volume successfully.
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-990a8ff6-5573-4573-8157-2dab173cb838 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-38fe3601-7d3f-48cc-b9d6-26d254685626-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-40fee8c6-417e-4b37-bf67-08edc604d9a9-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-40fee8c6-417e-4b37-bf67-08edc604d9a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-quobyte-40fee8c6-417e-4b37-bf67-08edc604d9a9" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-40fee8c6-417e-4b37-bf67-08edc604d9a9" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb71697-235c-4c1a-b73b-1f0b1c76cc0b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:35 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9
Sep 30 18:09:35 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:36 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9" returned: 0 in 0.359s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:36 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9
Sep 30 18:09:36 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:36 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-40fee8c6-417e-4b37-bf67-08edc604d9a9" returned: 0 in 0.236s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-40fee8c6-417e-4b37-bf67-08edc604d9a9" released by "delete_volume" :: held 0.637s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created reservations ['a8ba9b1e-90ba-4041-83b5-c799a642ebd8', '6efa054e-f02b-4ba0-8aff-abf999568d60', '4c56e7b1-9d2a-445f-8f8d-c4cc29cd96be', '798b4e87-0dfe-474d-8264-0a89f6a3a81f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:36 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:36 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:36 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.243s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Deleted volume successfully.
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-44525889-e939-42a6-82cd-0d287819b8d3 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-40fee8c6-417e-4b37-bf67-08edc604d9a9-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-3a4ffbc7-c89e-4880-82f4-bc549317624c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-3a4ffbc7-c89e-4880-82f4-bc549317624c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-quobyte-3a4ffbc7-c89e-4880-82f4-bc549317624c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-3a4ffbc7-c89e-4880-82f4-bc549317624c" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8969605-f223-47cf-8821-9a1cb203fd62]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:36 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c
Sep 30 18:09:36 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:37 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:37 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c
Sep 30 18:09:37 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:37 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3a4ffbc7-c89e-4880-82f4-bc549317624c" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-3a4ffbc7-c89e-4880-82f4-bc549317624c" released by "delete_volume" :: held 0.628s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created reservations ['cabbb281-f92d-4bff-a8be-d9a2e93f2a41', '5e51b442-993f-43ca-99d9-853539f97103', 'ae129a82-1af9-4284-b08e-ca64b6e48031', 'a42194ca-1ac7-45e1-b0e1-48d2a75d8123'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:37 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:37 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:37 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:37 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Deleted volume successfully.
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-00ee5983-fc4a-44f4-acd2-d5ead4454b53 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-3a4ffbc7-c89e-4880-82f4-bc549317624c-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "cinder-quobyte-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7459ef8b-de99-4885-805e-73bb24d3cb05]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:09:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:38 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c
Sep 30 18:09:38 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:38 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:38 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c
Sep 30 18:09:38 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:38 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-quobyte-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c" released by "delete_volume" :: held 0.620s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Created reservations ['39237f4f-6e73-4ca5-999f-fee10ce83657', '6223a0b5-3a43-449e-85a1-c5a2b97164ff', 'a9c1432d-6b20-4baa-95eb-5f523aa43af0', '0282a5eb-fd14-4789-b645-40955cfc3b8a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:38 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:38 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:38 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.233s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Deleted volume successfully.
Sep 30 18:09:38 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ae630348-6a75-4a56-b2bb-8ec2ca132b41 tempest-CreateVolumesFromSourceVolumeTest-2089174706 None] Lock "cinder-98b8829a-9e6e-4197-9d58-8b4ca2ddbf3c-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:46 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:09:46 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:46 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.243s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:09:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:09:48 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=42,cinder:UPDATE=62,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:09:48 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=70,cinder:SELECT=42,cinder:DELETE=8,cinder:INSERT=16 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9ac755fe-5fa1-4dc5-a83e-5cb0e16892d4 tempest-ProjectAdminTests-1166108647 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9045333862305, 'free_capacity_gb': 1774.9045333862305, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87418) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (264c2080-0f18-438b-bd7c-03e610ff8e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3b89ca-39a9-42b0-a77b-1ea51ec80134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3b89ca-39a9-42b0-a77b-1ea51ec80134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1242830140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf564a39-9462-4497-bcc0-91ea41806d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:55Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027d573f-3a4c-4683-83ae-16da43f0d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027d573f-3a4c-4683-83ae-16da43f0d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393b1dcd-1c4d-43d1-aaa9-ee9a24ca32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393b1dcd-1c4d-43d1-aaa9-ee9a24ca32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf564a39-9462-4497-bcc0-91ea41806d0d', 'volume_name': 'volume-bf564a39-9462-4497-bcc0-91ea41806d0d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d29cc0-1607-42dc-91eb-e2bb44856d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d29cc0-1607-42dc-91eb-e2bb44856d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc11e4e-1a0b-44ba-b75c-ed3b8734aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Volume bf564a39-9462-4497-bcc0-91ea41806d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf564a39-9462-4497-bcc0-91ea41806d0d', 'volume_size': 1}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1242830140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf564a39-9462-4497-bcc0-91ea41806d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:55Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Creating volume bf564a39-9462-4497-bcc0-91ea41806d0d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:55 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:55 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d 1073741824
Sep 30 18:09:55 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (5c0bb349-5e89-4f24-996a-a4728939e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5439766a-d393-4d2e-9b6c-7b6e7fe6983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (c88a754c-cd8c-401a-8b1b-fc378f64959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa918443-9c30-4257-8cf3-5700bb903041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5439766a-d393-4d2e-9b6c-7b6e7fe6983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256342021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da740430-e057-4043-bdd6-c32b745086d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:55Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e76bb5f-7f49-4dd5-b2d6-731a861172b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e76bb5f-7f49-4dd5-b2d6-731a861172b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e6eb0a-0f49-4179-813a-24930d5ab205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e6eb0a-0f49-4179-813a-24930d5ab205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da740430-e057-4043-bdd6-c32b745086d1', 'volume_name': 'volume-da740430-e057-4043-bdd6-c32b745086d1', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa600c-0427-4368-986d-c91faf295ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa600c-0427-4368-986d-c91faf295ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c006c5-b250-4704-897d-6b5e6ceee135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Volume da740430-e057-4043-bdd6-c32b745086d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da740430-e057-4043-bdd6-c32b745086d1', 'volume_size': 1}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa918443-9c30-4257-8cf3-5700bb903041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13577769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469d6a6b-2d25-4e1f-b58d-66e8ffb09e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:55Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc81ca70-5152-4bb7-88d5-3dfbb81521dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc81ca70-5152-4bb7-88d5-3dfbb81521dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe36882-6e14-497e-b214-4322740359d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe36882-6e14-497e-b214-4322740359d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469d6a6b-2d25-4e1f-b58d-66e8ffb09e33', 'volume_name': 'volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d359a87-4c94-4258-96fc-bfd5e2514770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d359a87-4c94-4258-96fc-bfd5e2514770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112f1d56-1056-4c2f-90bc-5dc938fce432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume 469d6a6b-2d25-4e1f-b58d-66e8ffb09e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33', 'volume_size': 1}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:55 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (18e440b6-7d4e-4c48-b9f7-36be7a1caec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb913c66-5fba-435c-835a-dc241748c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb913c66-5fba-435c-835a-dc241748c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63882834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fe4f82-98e2-4f88-ad09-baa4a37b2d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:56Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cd5b95-adbf-46ee-889c-d13094e78079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cd5b95-adbf-46ee-889c-d13094e78079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ab3886-6c9a-4560-8f76-79ee7abf9b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ab3886-6c9a-4560-8f76-79ee7abf9b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fe4f82-98e2-4f88-ad09-baa4a37b2d6a', 'volume_name': 'volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19eb337a-994d-4d61-a6fb-9e12dea8f53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19eb337a-994d-4d61-a6fb-9e12dea8f53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603966ca-7b02-4561-95cc-41093ed5beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Volume 13fe4f82-98e2-4f88-ad09-baa4a37b2d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a', 'volume_size': 1}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:56 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d 1073741824" returned: 0 in 0.798s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:56 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d
Sep 30 18:09:56 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (1443d5db-7826-4701-8934-40a43286f268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce4d496-d9cb-476a-a3c0-f4419c85410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce4d496-d9cb-476a-a3c0-f4419c85410b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782936370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912f42c4-1aae-41b8-9ad8-074b054af9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:56Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2869726-1ca4-432a-ba36-32a21ba13e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2869726-1ca4-432a-ba36-32a21ba13e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd947e4-7d42-46cf-b75e-9bba992169d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd947e4-7d42-46cf-b75e-9bba992169d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912f42c4-1aae-41b8-9ad8-074b054af9a1', 'volume_name': 'volume-912f42c4-1aae-41b8-9ad8-074b054af9a1', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95f9097-b2ce-4732-9810-5a4e28cfcd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95f9097-b2ce-4732-9810-5a4e28cfcd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98a53e2-5b15-4392-b898-dfad14eb84a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Volume 912f42c4-1aae-41b8-9ad8-074b054af9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912f42c4-1aae-41b8-9ad8-074b054af9a1', 'volume_size': 1}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:56 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d" returned: 0 in 0.386s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256342021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da740430-e057-4043-bdd6-c32b745086d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:55Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Creating volume da740430-e057-4043-bdd6-c32b745086d1 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:56 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:56 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1 1073741824
Sep 30 18:09:56 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc11e4e-1a0b-44ba-b75c-ed3b8734aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf564a39-9462-4497-bcc0-91ea41806d0d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66542768-2b1a-4704-8ad5-f859511b7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:56 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Volume volume-bf564a39-9462-4497-bcc0-91ea41806d0d (bf564a39-9462-4497-bcc0-91ea41806d0d): created successfully
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66542768-2b1a-4704-8ad5-f859511b7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:56 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (264c2080-0f18-438b-bd7c-03e610ff8e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-97e89fc8-8afe-4191-ac51-46859aa493bf tempest-CreateVolumesFromImageTest-825249 None] Created volume successfully.
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (fa8e5ed9-c337-48e2-bae0-b8552f14c84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b49a1-c968-4751-9aeb-97c21312b031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b49a1-c968-4751-9aeb-97c21312b031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1445199488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c110f41-3bfd-4f58-b25d-3aeac83b1f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:57Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cccdd2-18d2-4d0e-90d7-25e3b04f8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cccdd2-18d2-4d0e-90d7-25e3b04f8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dac63a-6d11-4187-86a2-c4ca3eafca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dac63a-6d11-4187-86a2-c4ca3eafca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c110f41-3bfd-4f58-b25d-3aeac83b1f5a', 'volume_name': 'volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3230eca9-0d12-4d6b-a7fa-54a1e9069637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3230eca9-0d12-4d6b-a7fa-54a1e9069637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfde8031-dce8-4b52-9fe8-c4f0f8e38367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Volume 3c110f41-3bfd-4f58-b25d-3aeac83b1f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a', 'volume_size': 1}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:57 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1 1073741824" returned: 0 in 0.620s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:57 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1
Sep 30 18:09:57 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:57 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1" returned: 0 in 0.270s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13577769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469d6a6b-2d25-4e1f-b58d-66e8ffb09e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:55Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating volume 469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:57 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:57 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 1073741824
Sep 30 18:09:57 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c006c5-b250-4704-897d-6b5e6ceee135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da740430-e057-4043-bdd6-c32b745086d1', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557aed2a-662a-4fe7-836f-e529c14536c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Volume volume-da740430-e057-4043-bdd6-c32b745086d1 (da740430-e057-4043-bdd6-c32b745086d1): created successfully
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557aed2a-662a-4fe7-836f-e529c14536c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (5c0bb349-5e89-4f24-996a-a4728939e633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7a74d3b4-7237-46c1-ae11-4f468a11ba1e tempest-CreateVolumesFromImageTest-825249 None] Created volume successfully.
Sep 30 18:09:58 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 1073741824" returned: 0 in 0.523s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:58 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33
Sep 30 18:09:58 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:58 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" returned: 0 in 0.275s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.501s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63882834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fe4f82-98e2-4f88-ad09-baa4a37b2d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:56Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Creating volume 13fe4f82-98e2-4f88-ad09-baa4a37b2d6a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:58 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112f1d56-1056-4c2f-90bc-5dc938fce432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:58 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a 1073741824
Sep 30 18:09:58 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfda53ba-7cdf-4c5b-8810-a47e74d1eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 (469d6a6b-2d25-4e1f-b58d-66e8ffb09e33): created successfully
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfda53ba-7cdf-4c5b-8810-a47e74d1eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (c88a754c-cd8c-401a-8b1b-fc378f64959b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5deb289c-2370-4ee9-ba73-fbd28a8ffdb6 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created volume successfully.
Sep 30 18:09:59 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a 1073741824" returned: 0 in 0.516s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:59 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a
Sep 30 18:09:59 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Flow 'volume_create_manager' (7127ab81-c8a5-4b40-9c22-fd34f70ee541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042a343c-30ec-4e5f-b9a1-8a5dd6a56e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:59 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a" returned: 0 in 0.359s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.917s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782936370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912f42c4-1aae-41b8-9ad8-074b054af9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:56Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Creating volume 912f42c4-1aae-41b8-9ad8-074b054af9a1 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:09:59 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042a343c-30ec-4e5f-b9a1-8a5dd6a56e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca0810f-3dae-4838-a484-471e1fad94ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4138af49e0c445597c4bb96ca30c205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:59Z,use_quota=True,user_id='5c965c3732f940e792049d904401bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c9de6b-ffb3-4338-864d-1d5fd2d53e99),volume_type_id=03c9de6b-ffb3-4338-864d-1d5fd2d53e99)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda34d07-6aec-4266-b575-b4eef677955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:59 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 1073741824
Sep 30 18:09:59 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda34d07-6aec-4266-b575-b4eef677955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621b1ed5-6f44-4264-8f83-e5e2aa4d7a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603966ca-7b02-4561-95cc-41093ed5beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0939b87-b2d3-4448-ae0f-7cb8c92966d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:09:59 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Volume volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a (13fe4f82-98e2-4f88-ad09-baa4a37b2d6a): created successfully
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0939b87-b2d3-4448-ae0f-7cb8c92966d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (18e440b6-7d4e-4c48-b9f7-36be7a1caec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:09:59 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-20e89a85-ac23-4b1b-862b-4d95d1171667 tempest-CreateVolumesFromImageTest-825249 None] Created volume successfully.
Sep 30 18:09:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621b1ed5-6f44-4264-8f83-e5e2aa4d7a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ca0810f-3dae-4838-a484-471e1fad94ae', 'volume_name': 'volume-7ca0810f-3dae-4838-a484-471e1fad94ae', 'volume_size': 1, 'image_id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '181d6676b90398876fae85bf6b35721b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4138af49e0c445597c4bb96ca30c205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3763a36504a3e59e4908f586a7b425427d7652c9cd782d9ebf5dc5beb1f113227d236cbb67328ba327832a5a02a264aac205a4ace4300e46c9cb6a73b53401aa', 'id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'created_at': datetime.datetime(2026, 9, 30, 16, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 9, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1497c2b10>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf0f51-1e64-487c-ad92-63046fba950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf0f51-1e64-487c-ad92-63046fba950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4292ee40-e2f8-4137-a051-6e25a0ca7386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:00 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Volume 7ca0810f-3dae-4838-a484-471e1fad94ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ca0810f-3dae-4838-a484-471e1fad94ae', 'volume_size': 1, 'image_id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '181d6676b90398876fae85bf6b35721b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4138af49e0c445597c4bb96ca30c205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3763a36504a3e59e4908f586a7b425427d7652c9cd782d9ebf5dc5beb1f113227d236cbb67328ba327832a5a02a264aac205a4ace4300e46c9cb6a73b53401aa', 'id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'created_at': datetime.datetime(2026, 9, 30, 16, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 9, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1497c2b10>}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Trying to clone 7ca0810f-3dae-4838-a484-471e1fad94ae from image f7eee1d2-6ca3-403f-8abb-a832e1ce7096 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:10:00 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 1073741824" returned: 0 in 0.555s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:00 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1
Sep 30 18:10:00 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:10:00 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba03d8-1bc6-4bb3-967c-daa925a9b645]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:00 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD
Sep 30 18:10:00 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:00 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1" returned: 0 in 0.270s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.253s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1445199488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c110f41-3bfd-4f58-b25d-3aeac83b1f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2bcc5985d4087a025adb88f0afb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:57Z,use_quota=True,user_id='df04c61ed3e546a4a015e06f67089a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Creating volume 3c110f41-3bfd-4f58-b25d-3aeac83b1f5a {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:00 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98a53e2-5b15-4392-b898-dfad14eb84a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912f42c4-1aae-41b8-9ad8-074b054af9a1', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:00 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a 1073741824
Sep 30 18:10:00 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2d4a1d-65e4-4163-ac3a-a5dd96adde83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:00 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Volume volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 (912f42c4-1aae-41b8-9ad8-074b054af9a1): created successfully
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2d4a1d-65e4-4163-ac3a-a5dd96adde83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (1443d5db-7826-4701-8934-40a43286f268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e18c8202-e9c6-4aaa-99f2-b5a549075eb8 tempest-CreateVolumesFromImageTest-825249 None] Created volume successfully.
Sep 30 18:10:00 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:00 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD
Sep 30 18:10:00 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:00 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a 1073741824" returned: 0 in 0.431s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:00 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a
Sep 30 18:10:00 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:00 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:00 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Temporary image f7eee1d2-6ca3-403f-8abb-a832e1ce7096 is fetched for user 5c965c3732f940e792049d904401bdab. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cdb1e1-f8fe-4284-9a21-828bbc68aeab]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:01 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD
Sep 30 18:10:01 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:01 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.446s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfde8031-dce8-4b52-9fe8-c4f0f8e38367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd3ceed-da7f-4d7c-ac9c-7c27dd51cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating offline snapshot 580115a1-710a-4220-91b6-57274cb6fe15 of volume 469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:10:01 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Volume volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a (3c110f41-3bfd-4f58-b25d-3aeac83b1f5a): created successfully
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd3ceed-da7f-4d7c-ac9c-7c27dd51cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Flow 'volume_create_manager' (fa8e5ed9-c337-48e2-bae0-b8552f14c84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8b8ea-5629-45a5-80e3-be913efa17ef]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-53c788f2-e64d-43ce-94dc-4b46829a30d5 tempest-CreateVolumesFromImageTest-825249 None] Created volume successfully.
Sep 30 18:10:01 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33
Sep 30 18:10:01 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:01 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:01 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD
Sep 30 18:10:01 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:01 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" returned: 0 in 0.447s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:01 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 1G
Sep 30 18:10:01 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:01 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-quobyte-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44c760a-ef1b-4505-8b12-9878c2b16ea6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:01 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a
Sep 30 18:10:01 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:02 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 1G" returned: 0 in 0.497s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:02 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15
Sep 30 18:10:02 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:02 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a" returned: 0 in 0.423s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:02 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a
Sep 30 18:10:02 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:02 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15" returned: 0 in 0.294s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:02 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 is being set with open permissions: ugo+rw
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:02 devstack sudo[107127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15
Sep 30 18:10:02 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:02 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a" released by "delete_volume" :: held 0.756s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Created reservations ['b6c92be8-8283-40f5-8458-194df41efce6', '2e028c3c-c212-45b0-b7e5-27f12d40a975', '5571a4d6-aa8a-464f-954d-a8dd76560cc3', 'd5d54e8a-6a7e-4e65-a01f-1e184b494ffb'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:02 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:02 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:02 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15" returned: 0 in 0.251s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:02 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info
Sep 30 18:10:02 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-912f42c4-1aae-41b8-9ad8-074b054af9a1-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-912f42c4-1aae-41b8-9ad8-074b054af9a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-quobyte-912f42c4-1aae-41b8-9ad8-074b054af9a1" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-912f42c4-1aae-41b8-9ad8-074b054af9a1" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df5737-3595-499c-a63c-e141bcfc77df]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:02 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.289s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:02 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Deleted volume successfully.
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5804380e-1bff-4f1f-8182-2bb817c9355c tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-3c110f41-3bfd-4f58-b25d-3aeac83b1f5a-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:03 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info" returned: 0 in 0.282s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:03 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info is being set with open permissions: ugo+rw
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:03 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info
Sep 30 18:10:03 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:03 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1
Sep 30 18:10:03 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:03 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.info" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca0810f-3dae-4838-a484-471e1fad94ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4138af49e0c445597c4bb96ca30c205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:09:59Z,use_quota=True,user_id='5c965c3732f940e792049d904401bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c9de6b-ffb3-4338-864d-1d5fd2d53e99),volume_type_id=03c9de6b-ffb3-4338-864d-1d5fd2d53e99)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Creating volume 7ca0810f-3dae-4838-a484-471e1fad94ae {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:03 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:03 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:03 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae 1073741824
Sep 30 18:10:03 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e01576f0-6985-4d6f-b809-8f6f64620109 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Create snapshot completed successfully
Sep 30 18:10:03 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1
Sep 30 18:10:03 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:03 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-912f42c4-1aae-41b8-9ad8-074b054af9a1" returned: 0 in 0.281s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-912f42c4-1aae-41b8-9ad8-074b054af9a1" released by "delete_volume" :: held 0.740s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Created reservations ['51f3a321-0989-4012-8d42-dde8f3cf295b', 'a0a58998-4815-4c95-ab7c-f0101251403e', '486a0fbe-4132-4881-be5f-0d8ed2f5670a', 'ef4dea47-bb34-4668-9f0b-138cc06f17ec'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:03 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:03 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:03 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae 1073741824" returned: 0 in 0.564s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:04 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae
Sep 30 18:10:04 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:04 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.325s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Deleted volume successfully.
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-quobyte-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d546dcfc-317c-4ef6-bafc-b71e480ce34b tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-912f42c4-1aae-41b8-9ad8-074b054af9a1-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b2cfd-f23f-4b93-a36f-d73b52122faa]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:04 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae" returned: 0 in 0.403s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Attempting download of f7eee1d2-6ca3-403f-8abb-a832e1ce7096 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'metadata': {}}])) to volume 7ca0810f-3dae-4838-a484-471e1fad94ae. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:10:04 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a
Sep 30 18:10:04 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[830cba2c-ace1-4576-93e5-c2111ba59bc2]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:04 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr
Sep 30 18:10:04 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (9941ab19-6005-4434-8949-2ca0a3a1d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0374f63e-3662-47e0-8319-41eb7be51ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0374f63e-3662-47e0-8319-41eb7be51ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140124906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce81c94-576d-4a6a-834e-f9c3c57a8378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:05Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e01699-944c-47d8-9163-7ced687e33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e01699-944c-47d8-9163-7ced687e33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144bedf0-b14e-43d9-bc03-15c2af22689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144bedf0-b14e-43d9-bc03-15c2af22689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce81c94-576d-4a6a-834e-f9c3c57a8378', 'volume_name': 'volume-fce81c94-576d-4a6a-834e-f9c3c57a8378', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9451230d-b6e8-454e-90b0-c90277cecec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9451230d-b6e8-454e-90b0-c90277cecec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b84fcba-dcd1-41f1-a13a-86d2ae16fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:04 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume fce81c94-576d-4a6a-834e-f9c3c57a8378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce81c94-576d-4a6a-834e-f9c3c57a8378', 'volume_size': 1}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140124906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce81c94-576d-4a6a-834e-f9c3c57a8378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:05Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating volume fce81c94-576d-4a6a-834e-f9c3c57a8378 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:04 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:04 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a" returned: 0 in 0.650s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:04 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 1073741824
Sep 30 18:10:04 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:04 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a
Sep 30 18:10:04 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:05 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr" returned: 0 in 0.490s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:05 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr
Sep 30 18:10:05 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (b2825023-fcb9-4ee9-af65-c444cf17da3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:05 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e26245-77d3-4841-a4b6-15efa7dc648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a" returned: 0 in 0.584s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a" released by "delete_volume" :: held 1.302s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e26245-77d3-4841-a4b6-15efa7dc648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1063594579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b24202-dca1-4956-9ffe-730ec408899c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:05Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522c666f-9ea8-4f7e-b56c-ebfc16df48d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522c666f-9ea8-4f7e-b56c-ebfc16df48d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7fde09-9793-4dfe-a88f-fb8254ad871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7fde09-9793-4dfe-a88f-fb8254ad871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b24202-dca1-4956-9ffe-730ec408899c', 'volume_name': 'volume-e4b24202-dca1-4956-9ffe-730ec408899c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8af19a-c74c-488b-9acf-b288adf16d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8af19a-c74c-488b-9acf-b288adf16d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dac740-47f1-4f45-a80e-8e435a0a8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume e4b24202-dca1-4956-9ffe-730ec408899c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b24202-dca1-4956-9ffe-730ec408899c', 'volume_size': 1}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:05 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr" returned: 1 in 0.619s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_32kfdovr' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43633b9-8b5f-4710-8df2-6e9548bae761]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:05 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 1073741824" returned: 0 in 0.815s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (c9eeac35-750e-408b-b1d2-42c4ec623d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12da95bd-5402-4a55-96aa-37d135ece8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:05 devstack sudo[107181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD
Sep 30 18:10:05 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12da95bd-5402-4a55-96aa-37d135ece8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906491954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f877de-096e-4747-b2fc-725976750161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:06Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d91106f-52b7-4387-b08f-6a1fe4fba9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378
Sep 30 18:10:05 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d91106f-52b7-4387-b08f-6a1fe4fba9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62688920-4557-41c8-911d-2400681613a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62688920-4557-41c8-911d-2400681613a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f877de-096e-4747-b2fc-725976750161', 'volume_name': 'volume-74f877de-096e-4747-b2fc-725976750161', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637b7731-95e1-4873-8a8e-4b78c643319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637b7731-95e1-4873-8a8e-4b78c643319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86fda2b-95ea-4a72-ac5b-6abc7f4ef3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume 74f877de-096e-4747-b2fc-725976750161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f877de-096e-4747-b2fc-725976750161', 'volume_size': 1}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:05 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Created reservations ['328c7a64-1a4e-4a36-9fd7-5022ffcfe3ce', '689cfef0-99b9-456b-b988-51ca897bd185', '77819924-2e85-4cfd-b6d0-7e482bfe4cf4', '9f46511d-430a-4153-8dd1-84e1b7d18183'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:06 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:06 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:06 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378" returned: 0 in 0.335s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1063594579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b24202-dca1-4956-9ffe-730ec408899c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:05Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating volume e4b24202-dca1-4956-9ffe-730ec408899c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:06 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b84fcba-dcd1-41f1-a13a-86d2ae16fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce81c94-576d-4a6a-834e-f9c3c57a8378', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6b46a9-a1a0-432c-bee0-de3eae9b9bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:06 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c 1073741824
Sep 30 18:10:06 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 (fce81c94-576d-4a6a-834e-f9c3c57a8378): created successfully
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6b46a9-a1a0-432c-bee0-de3eae9b9bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (9941ab19-6005-4434-8949-2ca0a3a1d35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-009c7e92-56a0-4bb4-8a29-8f82790a612f tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created volume successfully.
Sep 30 18:10:06 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD" returned: 0 in 0.697s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:06 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (a2090985-d093-48b4-9e21-0ad5b024ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ec2e38-9248-4212-a3c9-3df711c41139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.447s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Deleted volume successfully.
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ec2e38-9248-4212-a3c9-3df711c41139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592625042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd4d131-db1d-4cfc-adfe-546f1852d43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:06Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3102ab6-ac28-48b2-81cb-76d505af41b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3102ab6-ac28-48b2-81cb-76d505af41b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffbdf54-0509-4b7e-95db-8a0b0d844b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffbdf54-0509-4b7e-95db-8a0b0d844b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd4d131-db1d-4cfc-adfe-546f1852d43d', 'volume_name': 'volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da38839c-5430-44cd-9f1d-135efd8d9e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da38839c-5430-44cd-9f1d-135efd8d9e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dba882-4f14-40df-8c6a-eac687629b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume 3dd4d131-db1d-4cfc-adfe-546f1852d43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d', 'volume_size': 1}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:06 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD
Sep 30 18:10:06 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c945f1bd-9917-418d-85c7-6044f7810921 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-13fe4f82-98e2-4f88-ad09-baa4a37b2d6a-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-da740430-e057-4043-bdd6-c32b745086d1-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-da740430-e057-4043-bdd6-c32b745086d1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-quobyte-da740430-e057-4043-bdd6-c32b745086d1" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-da740430-e057-4043-bdd6-c32b745086d1" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a6f5e-e255-4e1c-98ee-cfee3227d082]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:06 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD" returned: 1 in 0.575s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] f7eee1d2-6ca3-403f-8abb-a832e1ce7096 was raw, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:06 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1
Sep 30 18:10:06 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:06 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c 1073741824" returned: 0 in 0.790s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:06 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae
Sep 30 18:10:06 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:07 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c
Sep 30 18:10:07 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (c76a097e-9dee-4384-a860-5d90a8500ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e6184f-4280-403d-9659-56e0f7a70bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e6184f-4280-403d-9659-56e0f7a70bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7719243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c540e5-473d-457b-bde2-af69a8302499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:07Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf9fb43-6f65-46a3-aeda-3be4066582f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf9fb43-6f65-46a3-aeda-3be4066582f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04700e4b-db79-4356-ba3e-2a43b7945ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04700e4b-db79-4356-ba3e-2a43b7945ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c540e5-473d-457b-bde2-af69a8302499', 'volume_name': 'volume-97c540e5-473d-457b-bde2-af69a8302499', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce01664e-2601-485d-b60e-f1fb392765a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce01664e-2601-485d-b60e-f1fb392765a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009e8d7-c035-4942-a9fe-749772982dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:07 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume 97c540e5-473d-457b-bde2-af69a8302499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c540e5-473d-457b-bde2-af69a8302499', 'volume_size': 1}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:07 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1" returned: 0 in 0.591s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:07 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1
Sep 30 18:10:07 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:07 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c" returned: 0 in 0.393s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906491954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f877de-096e-4747-b2fc-725976750161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:06Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating volume 74f877de-096e-4747-b2fc-725976750161 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:07 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dac740-47f1-4f45-a80e-8e435a0a8b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b24202-dca1-4956-9ffe-730ec408899c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c35b280-73e3-412c-8bb7-eb57b216e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:07 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161 1073741824
Sep 30 18:10:07 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:07 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume volume-e4b24202-dca1-4956-9ffe-730ec408899c (e4b24202-dca1-4956-9ffe-730ec408899c): created successfully
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c35b280-73e3-412c-8bb7-eb57b216e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (b2825023-fcb9-4ee9-af65-c444cf17da3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fcad358b-bc91-44de-9a72-fae231673e31 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created volume successfully.
Sep 30 18:10:07 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae" returned: 0 in 0.663s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7eee1d2-6ca3-403f-8abb-a832e1ce7096_crzwolr_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:10:07 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:07 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae 1G
Sep 30 18:10:07 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:07 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-da740430-e057-4043-bdd6-c32b745086d1" returned: 0 in 0.312s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-da740430-e057-4043-bdd6-c32b745086d1" released by "delete_volume" :: held 0.961s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Created reservations ['4362b05b-21b6-48d9-8605-501838400ebf', 'c397fc88-690b-4408-948d-20e23173a896', '5ce74651-3ad3-47c1-aa61-67de07c0e865', 'aa1bc61a-be72-4ddb-8a77-a53a36b29ea7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:07 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:07 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:08 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161 1073741824" returned: 0 in 0.590s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:08 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae 1G" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Downloaded image f7eee1d2-6ca3-403f-8abb-a832e1ce7096 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'metadata': {}}])) to volume 7ca0810f-3dae-4838-a484-471e1fad94ae successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Temporary image f7eee1d2-6ca3-403f-8abb-a832e1ce7096 for user 5c965c3732f940e792049d904401bdab is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Marking volume 7ca0810f-3dae-4838-a484-471e1fad94ae as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Copying metadata from image f7eee1d2-6ca3-403f-8abb-a832e1ce7096 to 7ca0810f-3dae-4838-a484-471e1fad94ae. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Creating volume glance metadata for volume 7ca0810f-3dae-4838-a484-471e1fad94ae backed by image f7eee1d2-6ca3-403f-8abb-a832e1ce7096 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '181d6676b90398876fae85bf6b35721b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:08 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161
Sep 30 18:10:08 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4292ee40-e2f8-4137-a051-6e25a0ca7386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca0810f-3dae-4838-a484-471e1fad94ae', 'volume_size': 1, 'image_id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '181d6676b90398876fae85bf6b35721b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4138af49e0c445597c4bb96ca30c205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3763a36504a3e59e4908f586a7b425427d7652c9cd782d9ebf5dc5beb1f113227d236cbb67328ba327832a5a02a264aac205a4ace4300e46c9cb6a73b53401aa', 'id': 'f7eee1d2-6ca3-403f-8abb-a832e1ce7096', 'created_at': datetime.datetime(2026, 9, 30, 16, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 9, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7eee1d2-6ca3-403f-8abb-a832e1ce7096/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1497c2b10>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:08 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1033c98-cca9-4ae9-b42d-72313de3ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.394s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Deleted volume successfully.
Sep 30 18:10:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Volume volume-7ca0810f-3dae-4838-a484-471e1fad94ae (7ca0810f-3dae-4838-a484-471e1fad94ae): created successfully
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1033c98-cca9-4ae9-b42d-72313de3ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Flow 'volume_create_manager' (7127ab81-c8a5-4b40-9c22-fd34f70ee541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-055b1ffa-7cf2-41fa-8d69-09a761255adf tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-da740430-e057-4043-bdd6-c32b745086d1-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b3fbe03c-c183-4cc5-a948-2923ca389311 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Created volume successfully.
Sep 30 18:10:08 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161" returned: 0 in 0.288s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592625042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd4d131-db1d-4cfc-adfe-546f1852d43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:06Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating volume 3dd4d131-db1d-4cfc-adfe-546f1852d43d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:08 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:08 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d 1073741824
Sep 30 18:10:08 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86fda2b-95ea-4a72-ac5b-6abc7f4ef3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f877de-096e-4747-b2fc-725976750161', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f0d202-09c0-4326-aee9-b0152cec9e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:08 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume volume-74f877de-096e-4747-b2fc-725976750161 (74f877de-096e-4747-b2fc-725976750161): created successfully
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f0d202-09c0-4326-aee9-b0152cec9e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (c9eeac35-750e-408b-b1d2-42c4ec623d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6083d80c-c56e-428d-9c02-1702455d0422 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created volume successfully.
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-bf564a39-9462-4497-bcc0-91ea41806d0d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:08 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d 1073741824" returned: 0 in 0.535s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-bf564a39-9462-4497-bcc0-91ea41806d0d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "cinder-quobyte-bf564a39-9462-4497-bcc0-91ea41806d0d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-bf564a39-9462-4497-bcc0-91ea41806d0d" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:09 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d
Sep 30 18:10:09 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e31ecc-dbcb-4314-8cad-f8685aff505b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d
Sep 30 18:10:09 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Acquiring lock "cinder-7ca0810f-3dae-4838-a484-471e1fad94ae-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:09 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d" returned: 0 in 0.295s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "cinder-7ca0810f-3dae-4838-a484-471e1fad94ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.098s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7719243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c540e5-473d-457b-bde2-af69a8302499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a148d87bea4b94b8e52418f43209d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:07Z,use_quota=True,user_id='d3cc3023a0474eeebb77b12d9e14176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Creating volume 97c540e5-473d-457b-bde2-af69a8302499 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:09 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dba882-4f14-40df-8c6a-eac687629b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b498bd3f-fc22-486a-ae50-2427fb91ff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:09 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499 1073741824
Sep 30 18:10:09 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d (3dd4d131-db1d-4cfc-adfe-546f1852d43d): created successfully
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b498bd3f-fc22-486a-ae50-2427fb91ff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (a2090985-d093-48b4-9e21-0ad5b024ebde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-582f949d-cca6-4ab5-a846-695f8c5316ee tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created volume successfully.
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Acquiring lock "cinder-quobyte-7ca0810f-3dae-4838-a484-471e1fad94ae" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "cinder-quobyte-7ca0810f-3dae-4838-a484-471e1fad94ae" acquired by "delete_volume" :: waited 0.051s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d684b5-85f8-4172-8a48-2978f4b951ba]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d" returned: 0 in 0.520s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d
Sep 30 18:10:09 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:09 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae
Sep 30 18:10:09 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (6c9e2796-df30-4d9f-b151-db1d5d955f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fe4533-cc59-4e9f-9a24-41ef24964457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fe4533-cc59-4e9f-9a24-41ef24964457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697988453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a386809-80f1-4dc1-bfab-8b8c9c894243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:10Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64dc4a0f-b25e-4df6-8bfc-a91bbe6679de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64dc4a0f-b25e-4df6-8bfc-a91bbe6679de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380c0cc0-e4bf-4f69-83e0-0cb1877d4471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380c0cc0-e4bf-4f69-83e0-0cb1877d4471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a386809-80f1-4dc1-bfab-8b8c9c894243', 'volume_name': 'volume-5a386809-80f1-4dc1-bfab-8b8c9c894243', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd138b17-79dc-41f5-ae2c-ccaaf3d81d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd138b17-79dc-41f5-ae2c-ccaaf3d81d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eccd91f-d8cc-46a7-bcbb-5ef554c1eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:09 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Volume 5a386809-80f1-4dc1-bfab-8b8c9c894243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a386809-80f1-4dc1-bfab-8b8c9c894243', 'volume_size': 1}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:09 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-bf564a39-9462-4497-bcc0-91ea41806d0d" returned: 0 in 0.294s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:09 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499 1073741824" returned: 0 in 0.559s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-quobyte-bf564a39-9462-4497-bcc0-91ea41806d0d" released by "delete_volume" :: held 0.868s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:09 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499
Sep 30 18:10:09 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae
Sep 30 18:10:09 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:09 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Created reservations ['1469d08e-a1fc-46ef-bbaa-d74a2400074c', '40a73726-75cc-4e84-8822-68c1589c9b02', '300029bd-b537-4027-8709-c1445d914d5f', '736db01d-1be4-4013-8d2e-5df1d2f1d87d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:10 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:10 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:10 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499" returned: 0 in 0.276s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697988453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a386809-80f1-4dc1-bfab-8b8c9c894243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:10Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Creating volume 5a386809-80f1-4dc1-bfab-8b8c9c894243 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:10 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:10 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-7ca0810f-3dae-4838-a484-471e1fad94ae" returned: 0 in 0.293s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:10 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 1073741824
Sep 30 18:10:10 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009e8d7-c035-4942-a9fe-749772982dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c540e5-473d-457b-bde2-af69a8302499', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1446bbe7-8415-494e-88d4-26c5487c3072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:10 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Volume volume-97c540e5-473d-457b-bde2-af69a8302499 (97c540e5-473d-457b-bde2-af69a8302499): created successfully
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1446bbe7-8415-494e-88d4-26c5487c3072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Flow 'volume_create_manager' (c76a097e-9dee-4384-a860-5d90a8500ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "cinder-quobyte-7ca0810f-3dae-4838-a484-471e1fad94ae" released by "delete_volume" :: held 0.813s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b7c03156-7968-4ce4-a0b3-75596220f2d1 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created volume successfully.
Sep 30 18:10:10 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.295s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Deleted volume successfully.
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-45ebd361-f149-4086-a86f-7a48ec7264c9 tempest-CreateVolumesFromImageTest-825249 None] Lock "cinder-bf564a39-9462-4497-bcc0-91ea41806d0d-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Created reservations ['4ca6a3a8-d77d-4500-9fd1-b46f4e5ec8d5', '1b73cf6f-be50-4dc4-98fc-568f74a43315', '98af0aef-f0c3-4256-9e76-df01956841e0', '6adf3464-45c1-4def-9298-bf0b5d476ae7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:10 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:10 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-97c540e5-473d-457b-bde2-af69a8302499-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-97c540e5-473d-457b-bde2-af69a8302499-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-97c540e5-473d-457b-bde2-af69a8302499" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-97c540e5-473d-457b-bde2-af69a8302499" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31c4f6-95ad-4f6c-8a52-99d6ed03edab]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:10 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:10 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Deleted volume successfully.
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 1073741824" returned: 0 in 0.683s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5270d70b-4d34-4c6a-94a3-c51c117d0a57 tempest-VolumeAndVolumeTypeFromImageTest-1065921725 None] Lock "cinder-7ca0810f-3dae-4838-a484-471e1fad94ae-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:10 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243
Sep 30 18:10:10 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:11 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499
Sep 30 18:10:11 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:11 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eccd91f-d8cc-46a7-bcbb-5ef554c1eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a386809-80f1-4dc1-bfab-8b8c9c894243', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3911c3-7c67-4fc5-8352-342580b66e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:11 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Volume volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 (5a386809-80f1-4dc1-bfab-8b8c9c894243): created successfully
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3911c3-7c67-4fc5-8352-342580b66e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (6c9e2796-df30-4d9f-b151-db1d5d955f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:11 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9432cb85-30c6-4280-a356-025170c9de0e tempest-ProjectReaderTests-1936290260 None] Created volume successfully.
Sep 30 18:10:11 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499" returned: 0 in 0.449s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:11 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499
Sep 30 18:10:11 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:11 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-97c540e5-473d-457b-bde2-af69a8302499" returned: 0 in 0.251s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-97c540e5-473d-457b-bde2-af69a8302499" released by "delete_volume" :: held 0.767s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['1fa564b8-6fde-4e93-9bb7-c4ae03dcee50', 'e5e4db2b-ddac-4e20-b7b8-8f90e6c5dcf4', '507a6244-3e1d-41ba-bd3c-482e7e5b6dd1', '9ee84535-4eb6-43c4-84ac-6e5457ae626e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:11 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:11 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-3dd4d131-db1d-4cfc-adfe-546f1852d43d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-3dd4d131-db1d-4cfc-adfe-546f1852d43d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-3dd4d131-db1d-4cfc-adfe-546f1852d43d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-3dd4d131-db1d-4cfc-adfe-546f1852d43d" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a43c41-148a-4e15-bd34-9a1145823a3f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-5a386809-80f1-4dc1-bfab-8b8c9c894243-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Lock "cinder-5a386809-80f1-4dc1-bfab-8b8c9c894243-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:12 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.417s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:12 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleted volume successfully.
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-quobyte-5a386809-80f1-4dc1-bfab-8b8c9c894243" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e2625811-d659-4947-9ba8-666df06c38dd tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-97c540e5-473d-457b-bde2-af69a8302499-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-5a386809-80f1-4dc1-bfab-8b8c9c894243" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05dfc83-3bf4-4959-8888-d415cfcb2a14]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:12 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d
Sep 30 18:10:12 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:12 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243
Sep 30 18:10:12 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:12 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d" returned: 0 in 0.608s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:12 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d
Sep 30 18:10:12 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:12 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243" returned: 0 in 0.503s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:12 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243
Sep 30 18:10:12 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:13 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-3dd4d131-db1d-4cfc-adfe-546f1852d43d" returned: 0 in 0.312s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-3dd4d131-db1d-4cfc-adfe-546f1852d43d" released by "delete_volume" :: held 1.007s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['a1943283-6b08-4376-aabf-256b20e2cf60', '73e36170-1de3-45e6-b770-d68c598ac4ff', '21174b88-7c04-43f4-844c-350f5da1816f', 'a4b9fd9e-82e0-46bf-9ffc-51d6c2441053'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-5a386809-80f1-4dc1-bfab-8b8c9c894243" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-5a386809-80f1-4dc1-bfab-8b8c9c894243" released by "delete_volume" :: held 0.934s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:13 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Created reservations ['51c7a77c-dc0e-4433-9f50-c2c1802427a7', '574ab5a4-02e3-45cd-a948-9b5ff1f3ac1b', '370e62f5-b6e0-4b61-9d0b-e71335dfc34a', '02934e55-4bf4-485f-94ad-374d7037565c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:13 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:13 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:13 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:13 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:13 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.474s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleted volume successfully.
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4557d82d-2a9d-42f8-b317-fc46a9378bbf tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-3dd4d131-db1d-4cfc-adfe-546f1852d43d-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:13 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.401s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Deleted volume successfully.
Sep 30 18:10:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1d483340-209d-4454-886a-dbbfcc5d9ecc tempest-ProjectReaderTests-1936290260 None] Lock "cinder-5a386809-80f1-4dc1-bfab-8b8c9c894243-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-74f877de-096e-4747-b2fc-725976750161-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-74f877de-096e-4747-b2fc-725976750161-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-74f877de-096e-4747-b2fc-725976750161" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-74f877de-096e-4747-b2fc-725976750161" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bfa970-878d-4ce9-a268-57585d5a0a00]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:14 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161
Sep 30 18:10:14 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:14 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161" returned: 0 in 0.495s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:14 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161
Sep 30 18:10:14 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:15 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-74f877de-096e-4747-b2fc-725976750161" returned: 0 in 0.318s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-74f877de-096e-4747-b2fc-725976750161" released by "delete_volume" :: held 0.883s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (33b5dc22-aa3b-4e0b-ab01-eb35875ef624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a101afca-2700-4c64-9abc-5a360d959047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a101afca-2700-4c64-9abc-5a360d959047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28033507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419ec73c-5374-479e-90a4-188a853a9327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:15Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18aeb76-e99c-4622-954e-0d07e0ee1607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18aeb76-e99c-4622-954e-0d07e0ee1607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a674c-d56b-456d-8e20-fd44b839aef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a674c-d56b-456d-8e20-fd44b839aef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419ec73c-5374-479e-90a4-188a853a9327', 'volume_name': 'volume-419ec73c-5374-479e-90a4-188a853a9327', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30051cb-4c7a-4539-8605-059266649283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30051cb-4c7a-4539-8605-059266649283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334b861b-fe9f-41c8-8855-09df386d59d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:15 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Volume 419ec73c-5374-479e-90a4-188a853a9327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419ec73c-5374-479e-90a4-188a853a9327', 'volume_size': 1}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28033507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419ec73c-5374-479e-90a4-188a853a9327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:15Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Creating volume 419ec73c-5374-479e-90a4-188a853a9327 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:15 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:15 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327 1073741824
Sep 30 18:10:15 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['5b6b86fa-3ab9-4c9f-9811-b12b0e1e2c3b', '5b1e42af-b7c2-4144-9f26-d6b349f69a01', '0373b6fe-2f94-4d37-bf5a-718c8625a50e', '2212e5f9-9dae-41dd-89a6-0edb9999d814'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:15 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:15 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:15 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.279s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleted volume successfully.
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-95cc4636-9e04-4950-a3cb-6b6c6433cea7 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-74f877de-096e-4747-b2fc-725976750161-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:15 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327 1073741824" returned: 0 in 0.544s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:15 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327
Sep 30 18:10:15 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:16 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334b861b-fe9f-41c8-8855-09df386d59d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419ec73c-5374-479e-90a4-188a853a9327', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23116233-9928-4388-a120-750a8817c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:16 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Volume volume-419ec73c-5374-479e-90a4-188a853a9327 (419ec73c-5374-479e-90a4-188a853a9327): created successfully
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23116233-9928-4388-a120-750a8817c828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (33b5dc22-aa3b-4e0b-ab01-eb35875ef624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:16 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-34d0a4ec-849e-4bda-944d-c01b2c811fe6 tempest-ProjectReaderTests-1936290260 None] Created volume successfully.
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-e4b24202-dca1-4956-9ffe-730ec408899c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-e4b24202-dca1-4956-9ffe-730ec408899c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-e4b24202-dca1-4956-9ffe-730ec408899c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-e4b24202-dca1-4956-9ffe-730ec408899c" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacc4133-01a6-4b8e-ac32-46cfeed22c6b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:16 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c
Sep 30 18:10:16 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:17 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:17 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c
Sep 30 18:10:17 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-419ec73c-5374-479e-90a4-188a853a9327-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-419ec73c-5374-479e-90a4-188a853a9327-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-quobyte-419ec73c-5374-479e-90a4-188a853a9327" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-419ec73c-5374-479e-90a4-188a853a9327" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fca889-2c59-4e09-97ac-c55ff9ffcbbd]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:17 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e4b24202-dca1-4956-9ffe-730ec408899c" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-e4b24202-dca1-4956-9ffe-730ec408899c" released by "delete_volume" :: held 0.921s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:17 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327
Sep 30 18:10:17 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['9cf8facb-2400-4603-938b-5b3f055c13e3', '93764852-078c-4be5-9cea-885242163382', '0abef9a3-8908-438f-90c6-e9840d9fe308', '919c9941-64d0-48b7-911c-ef479eea0e1c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:17 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:17 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-fce81c94-576d-4a6a-834e-f9c3c57a8378-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (ddefc4d8-4546-4790-abfd-3fa0a7744ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4915d5-3880-4369-ba0f-83167eb919ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-fce81c94-576d-4a6a-834e-f9c3c57a8378-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4915d5-3880-4369-ba0f-83167eb919ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072451172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99308f29-1464-47d8-b7cc-5602dedd2cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:18Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6d7c56-0bc1-40e2-bc40-a2cab1ee1af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6d7c56-0bc1-40e2-bc40-a2cab1ee1af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0542cdf8-825c-460f-9562-9fc346faffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0542cdf8-825c-460f-9562-9fc346faffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99308f29-1464-47d8-b7cc-5602dedd2cab', 'volume_name': 'volume-99308f29-1464-47d8-b7cc-5602dedd2cab', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bbe844-3a45-430a-b271-57387f074988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bbe844-3a45-430a-b271-57387f074988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd80320b-bd42-4359-b1a9-52788ff17721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:17 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume 99308f29-1464-47d8-b7cc-5602dedd2cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99308f29-1464-47d8-b7cc-5602dedd2cab', 'volume_size': 1}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072451172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99308f29-1464-47d8-b7cc-5602dedd2cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:18Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Creating volume 99308f29-1464-47d8-b7cc-5602dedd2cab {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:17 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:17 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:17 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab 1073741824
Sep 30 18:10:17 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:17 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-fce81c94-576d-4a6a-834e-f9c3c57a8378" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:17 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-fce81c94-576d-4a6a-834e-f9c3c57a8378" acquired by "delete_volume" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bece55b-8aba-4a96-b57e-edbac6237b40]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:17 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.331s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleted volume successfully.
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ec88180-1926-43bc-b3c4-378537b89e3e tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-e4b24202-dca1-4956-9ffe-730ec408899c-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:18 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378
Sep 30 18:10:18 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:18 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-419ec73c-5374-479e-90a4-188a853a9327" returned: 0 in 0.306s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-419ec73c-5374-479e-90a4-188a853a9327" released by "delete_volume" :: held 0.846s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Created reservations ['438330d4-b10e-4c5e-b6f8-a281959b17d6', 'a35361cb-b2ba-4b38-8002-5c788ac19849', '84480fc1-8f57-4f81-baf6-a32790ed5f01', '1fbddf6a-9275-4c78-98c7-59f0fcd69dd3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:18 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab 1073741824" returned: 0 in 0.578s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378" returned: 0 in 0.474s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:18 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378
Sep 30 18:10:18 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:18 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:18 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:18 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab
Sep 30 18:10:18 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:18 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fce81c94-576d-4a6a-834e-f9c3c57a8378" returned: 0 in 0.371s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-fce81c94-576d-4a6a-834e-f9c3c57a8378" released by "delete_volume" :: held 0.906s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:18 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.355s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Deleted volume successfully.
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0c7016f2-d47b-45aa-a5ed-dc20dd117577 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-419ec73c-5374-479e-90a4-188a853a9327-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:18 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab" returned: 0 in 0.364s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['36d13e8b-7a89-4082-afec-34bcf3ccd528', 'd7d454bf-f5d4-4360-9a4a-dbc8a3321b1f', 'f59877d4-7c6f-4cb6-b3b3-3128be7b1daf', '1bf61c2a-3e87-44f3-b329-ad00554522fa'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd80320b-bd42-4359-b1a9-52788ff17721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99308f29-1464-47d8-b7cc-5602dedd2cab', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1b5b01-e7c5-4c8d-b82b-f96bfe62a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:18 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume volume-99308f29-1464-47d8-b7cc-5602dedd2cab (99308f29-1464-47d8-b7cc-5602dedd2cab): created successfully
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1b5b01-e7c5-4c8d-b82b-f96bfe62a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (ddefc4d8-4546-4790-abfd-3fa0a7744ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ff288233-0883-48fd-9e4e-73e9196e41f8 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created volume successfully.
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:19 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:19 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (513ad06f-a7a7-400e-bf72-9cb7198ed7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d216ee-baed-424f-8f72-4fc976699bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d216ee-baed-424f-8f72-4fc976699bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735630499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a9ef3-1455-48eb-8997-239691662984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:19Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7a5899-b5ee-42e6-9ce1-d4cd07253c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7a5899-b5ee-42e6-9ce1-d4cd07253c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082821d1-00ac-41c0-9695-7301efd9d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082821d1-00ac-41c0-9695-7301efd9d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423a9ef3-1455-48eb-8997-239691662984', 'volume_name': 'volume-423a9ef3-1455-48eb-8997-239691662984', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c7e46b-5598-4c42-9b61-b0ff353a25bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c7e46b-5598-4c42-9b61-b0ff353a25bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b03f5f-4690-4166-8590-c9a7d5a93ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:19 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Volume 423a9ef3-1455-48eb-8997-239691662984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423a9ef3-1455-48eb-8997-239691662984', 'volume_size': 1}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735630499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a9ef3-1455-48eb-8997-239691662984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:19Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Creating volume 423a9ef3-1455-48eb-8997-239691662984 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:19 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:19 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:19 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleted volume successfully.
Sep 30 18:10:19 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984 1073741824
Sep 30 18:10:19 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c16d40de-7a13-44e6-9b39-33d89fd2494a tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-fce81c94-576d-4a6a-834e-f9c3c57a8378-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:19 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984 1073741824" returned: 0 in 0.429s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:19 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984
Sep 30 18:10:19 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:20 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984" returned: 0 in 0.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b03f5f-4690-4166-8590-c9a7d5a93ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423a9ef3-1455-48eb-8997-239691662984', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7213fb80-b172-46c7-8244-3e574448ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-580115a1-710a-4220-91b6-57274cb6fe15-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Volume volume-423a9ef3-1455-48eb-8997-239691662984 (423a9ef3-1455-48eb-8997-239691662984): created successfully
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7213fb80-b172-46c7-8244-3e574448ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (513ad06f-a7a7-400e-bf72-9cb7198ed7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-580115a1-710a-4220-91b6-57274cb6fe15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-56973acf-fb9b-4c5f-82da-48c1860651fd tempest-ProjectReaderTests-1936290260 None] Created volume successfully.
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-580115a1-710a-4220-91b6-57274cb6fe15" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-580115a1-710a-4220-91b6-57274cb6fe15" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleting offline snapshot 580115a1-710a-4220-91b6-57274cb6fe15 of volume 469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] snapshot_file for this snap is: volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd236f7-b7f4-4afc-80cd-bec898cd4f07]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (c43fbde0-bd88-4dfb-b913-c879587ebe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4c2ab9-86c1-441a-97c0-fad7af635d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4c2ab9-86c1-441a-97c0-fad7af635d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1614160095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b5e6ad-b45f-43ec-8018-aa5c20b8faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:20Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f8cafe-59a4-4fcb-9fb0-8f3d0ac34583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f8cafe-59a4-4fcb-9fb0-8f3d0ac34583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4485cbf2-4eda-43b0-8f6c-252010b82bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4485cbf2-4eda-43b0-8f6c-252010b82bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b5e6ad-b45f-43ec-8018-aa5c20b8faca', 'volume_name': 'volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48efbb6-cbff-4f8d-96be-a11afc10f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48efbb6-cbff-4f8d-96be-a11afc10f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15
Sep 30 18:10:20 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b77a20-ba99-44fb-b388-fdd5f9c4c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume 21b5e6ad-b45f-43ec-8018-aa5c20b8faca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca', 'volume_size': 1}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1614160095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b5e6ad-b45f-43ec-8018-aa5c20b8faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:20Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Creating volume 21b5e6ad-b45f-43ec-8018-aa5c20b8faca {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:20 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:20 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca 1073741824
Sep 30 18:10:20 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (e47dfdc2-c63a-4124-a992-d6c2db70e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b80912-2d28-487c-a235-f628238026a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15" returned: 0 in 0.532s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b80912-2d28-487c-a235-f628238026a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989334767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:21Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31969ed0-53a5-4ac8-8287-11d6bd268620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31969ed0-53a5-4ac8-8287-11d6bd268620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5928c111-5793-4f30-a010-e238aea07c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5928c111-5793-4f30-a010-e238aea07c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d', 'volume_name': 'volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325ea480-0298-4be5-8c11-db7050d0a23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325ea480-0298-4be5-8c11-db7050d0a23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d65edd-4d41-4c64-b18d-4bafb2dab120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d', 'volume_size': 1}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a26331-61c0-4424-8d8a-b62ca7f446d0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:20 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33
Sep 30 18:10:20 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:21 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca 1073741824" returned: 0 in 0.704s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:21 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca
Sep 30 18:10:21 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (93bf1970-b402-4f24-98b6-ae89dfb7683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1de194e-97df-4a3b-b5c7-3b6dc0c53fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1de194e-97df-4a3b-b5c7-3b6dc0c53fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-587227337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f28b76-4d35-4d23-bd4d-6e3647715875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:21Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338014d9-e99d-4cdb-a5e1-124c7dfb3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338014d9-e99d-4cdb-a5e1-124c7dfb3f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52753e6-f3ae-4ac8-9979-5478ccb98abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52753e6-f3ae-4ac8-9979-5478ccb98abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f28b76-4d35-4d23-bd4d-6e3647715875', 'volume_name': 'volume-d7f28b76-4d35-4d23-bd4d-6e3647715875', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3834ef4f-e6e7-46e5-9962-19029dcd925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3834ef4f-e6e7-46e5-9962-19029dcd925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960e1ff0-8b3f-45a6-a61a-75137ec6ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume d7f28b76-4d35-4d23-bd4d-6e3647715875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f28b76-4d35-4d23-bd4d-6e3647715875', 'volume_size': 1}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:21 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" returned: 0 in 0.600s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:21 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15
Sep 30 18:10:21 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-423a9ef3-1455-48eb-8997-239691662984-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:21 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Lock "cinder-423a9ef3-1455-48eb-8997-239691662984-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca" returned: 0 in 0.507s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989334767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:21Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Creating volume df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:21 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b77a20-ba99-44fb-b388-fdd5f9c4c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:21 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d 1073741824
Sep 30 18:10:21 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3fa238-d012-47f0-a4c7-678c301a154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca (21b5e6ad-b45f-43ec-8018-aa5c20b8faca): created successfully
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3fa238-d012-47f0-a4c7-678c301a154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (c43fbde0-bd88-4dfb-b913-c879587ebe71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-quobyte-423a9ef3-1455-48eb-8997-239691662984" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5e0fe5c8-4a09-4224-8916-98838948757f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created volume successfully.
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-423a9ef3-1455-48eb-8997-239691662984" acquired by "delete_volume" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[99453769-61f9-45f2-97f0-f9a700e5ac76]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (529e6c79-b250-4343-8399-19cdaf601e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ab96f7-f5fb-441f-a4bf-afb9cbce2200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ab96f7-f5fb-441f-a4bf-afb9cbce2200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862250435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc349c20-869b-40e2-826d-cb953d8c796e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:22Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7247b326-4c99-4360-954e-e1547521aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7247b326-4c99-4360-954e-e1547521aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6822a77-57f7-4c5f-9367-8091802f5141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6822a77-57f7-4c5f-9367-8091802f5141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc349c20-869b-40e2-826d-cb953d8c796e', 'volume_name': 'volume-dc349c20-869b-40e2-826d-cb953d8c796e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaa727a-ec53-46d2-b255-034e9b05d92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaa727a-ec53-46d2-b255-034e9b05d92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cf236d-5859-47c8-8ad8-990a5d3cfb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume dc349c20-869b-40e2-826d-cb953d8c796e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc349c20-869b-40e2-826d-cb953d8c796e', 'volume_size': 1}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:22 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15" returned: 0 in 0.625s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:22 devstack sudo[107428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15
Sep 30 18:10:22 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:22 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984
Sep 30 18:10:22 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:22 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33.580115a1-710a-4220-91b6-57274cb6fe15" returned: 0 in 0.386s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:22 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d 1073741824" returned: 0 in 0.856s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-580115a1-710a-4220-91b6-57274cb6fe15" released by "_delete_snapshot" :: held 2.358s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" released by "delete_snapshot" :: held 2.417s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:22 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (fb0b7980-33c5-4838-a975-f7fd00269cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b628ac-a55b-43d2-89d1-efd7fb6c7eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984" returned: 0 in 0.772s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:22 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d
Sep 30 18:10:22 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:22 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984
Sep 30 18:10:22 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b628ac-a55b-43d2-89d1-efd7fb6c7eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1437638969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c336f9-9e94-40a4-a78a-3bc3529e7fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:22Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6799490-1f6a-47b9-a79a-7564d727c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6799490-1f6a-47b9-a79a-7564d727c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806be5db-8086-49f4-8d3d-4291552cc093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806be5db-8086-49f4-8d3d-4291552cc093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c336f9-9e94-40a4-a78a-3bc3529e7fda', 'volume_name': 'volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268149e9-1039-4bac-b56c-9e07c487fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268149e9-1039-4bac-b56c-9e07c487fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d66c50-6923-4be5-9a9a-4c79223bdc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume 37c336f9-9e94-40a4-a78a-3bc3529e7fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda', 'volume_size': 1}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['20ab8b61-61f3-43fa-bdc5-333ea601f05f', '63aa89a7-2b8c-4035-8266-ff93c3f8d6ef', '64978e38-bada-4a7c-a00a-22bec315f4c2', 'a4e7bd78-c9be-4fb5-b132-0b28cb1728d5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:22 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Delete snapshot completed successfully.
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98daf422-7e37-4f02-9538-f7e25f029771 tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-580115a1-710a-4220-91b6-57274cb6fe15-delete_snapshot" released by "delete_snapshot" :: held 2.781s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:22 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d" returned: 0 in 0.306s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-587227337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f28b76-4d35-4d23-bd4d-6e3647715875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:21Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Creating volume d7f28b76-4d35-4d23-bd4d-6e3647715875 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:22 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d65edd-4d41-4c64-b18d-4bafb2dab120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:22 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:22 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 1073741824
Sep 30 18:10:22 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db74f32f-1c1f-417c-82e0-d581bfcb8d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-423a9ef3-1455-48eb-8997-239691662984" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-423a9ef3-1455-48eb-8997-239691662984" released by "delete_volume" :: held 1.176s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:22 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d (df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d): created successfully
Sep 30 18:10:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db74f32f-1c1f-417c-82e0-d581bfcb8d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (e47dfdc2-c63a-4124-a992-d6c2db70e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dfbd39ac-17da-4be1-9964-9671b65dbd45 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created volume successfully.
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Created reservations ['39531e5d-0f18-4940-805e-f7b507bf64a0', 'c7c3ddfc-ff47-428b-a625-a41e599866e7', 'b83e03bb-5edc-4a87-b9d5-2cdb553ff202', 'c57d5f9f-f5db-48af-a838-3d0b7d611842'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:23 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:23 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:23 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.314s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:23 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Deleted volume successfully.
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 1073741824" returned: 0 in 0.550s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5ef632b5-d2f7-4ffb-bfb2-c4fccc6e84ca tempest-ProjectReaderTests-1936290260 None] Lock "cinder-423a9ef3-1455-48eb-8997-239691662984-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "cinder-quobyte-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:23 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875
Sep 30 18:10:23 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" acquired by "delete_volume" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd31cd-3b74-4ef7-9bd9-bc3b8fe9bce1]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:23 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33
Sep 30 18:10:23 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:23 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862250435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc349c20-869b-40e2-826d-cb953d8c796e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:22Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Creating volume dc349c20-869b-40e2-826d-cb953d8c796e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:23 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:23 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e 1073741824
Sep 30 18:10:23 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960e1ff0-8b3f-45a6-a61a-75137ec6ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f28b76-4d35-4d23-bd4d-6e3647715875', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dcadb1-bfa7-4a61-a15b-45dce904b078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:23 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 (d7f28b76-4d35-4d23-bd4d-6e3647715875): created successfully
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dcadb1-bfa7-4a61-a15b-45dce904b078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:23 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (93bf1970-b402-4f24-98b6-ae89dfb7683d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-53fccd48-91fb-4663-92f4-3346a81569f0 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created volume successfully.
Sep 30 18:10:24 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" returned: 0 in 0.448s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:24 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33
Sep 30 18:10:24 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:24 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e 1073741824" returned: 0 in 0.607s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:24 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-quobyte-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33" released by "delete_volume" :: held 0.900s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:24 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e
Sep 30 18:10:24 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (22898f5f-02ea-4257-adca-466e63e43f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff180c86-8d7f-46f8-94b3-3c3740a3464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff180c86-8d7f-46f8-94b3-3c3740a3464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41222084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73236d1-d912-4a63-8e86-935ba75a30f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:24Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c81712d-556b-4334-88db-429c09986135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c81712d-556b-4334-88db-429c09986135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075adf31-edf5-429b-9eb7-3c3c426f3a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075adf31-edf5-429b-9eb7-3c3c426f3a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73236d1-d912-4a63-8e86-935ba75a30f5', 'volume_name': 'volume-c73236d1-d912-4a63-8e86-935ba75a30f5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e32309f-08dc-4f44-9216-3c2eed88dc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e32309f-08dc-4f44-9216-3c2eed88dc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d08b3a7-3e26-4570-9bae-f5044c2e9992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:24 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Volume c73236d1-d912-4a63-8e86-935ba75a30f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73236d1-d912-4a63-8e86-935ba75a30f5', 'volume_size': 1}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Created reservations ['6a90d144-bbbc-4883-987f-3d6585f5480a', 'f3aa9f3c-5158-43f4-8a00-02a11a0a53cd', '1c7dc9c7-40df-4ddd-bcf9-e6e0c121116a', '17a3cc1b-b1cc-4ebc-bc91-d7dbe46fabc2'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:24 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:24 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:24 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e" returned: 0 in 0.309s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.132s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1437638969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c336f9-9e94-40a4-a78a-3bc3529e7fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e90fab76414311a657b195a7a7bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:22Z,use_quota=True,user_id='3b438ce47f3f4550a2b4c6821a8eb399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Creating volume 37c336f9-9e94-40a4-a78a-3bc3529e7fda {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:24 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cf236d-5859-47c8-8ad8-990a5d3cfb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc349c20-869b-40e2-826d-cb953d8c796e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d78e3e-5c65-4ff8-9209-cbaeb2506d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:24 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda 1073741824
Sep 30 18:10:24 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:24 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume volume-dc349c20-869b-40e2-826d-cb953d8c796e (dc349c20-869b-40e2-826d-cb953d8c796e): created successfully
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d78e3e-5c65-4ff8-9209-cbaeb2506d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (529e6c79-b250-4343-8399-19cdaf601e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1361b7a9-7144-45e8-81e9-9929bdddaff5 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created volume successfully.
Sep 30 18:10:25 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.279s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Deleted volume successfully.
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-aa5533d9-5f48-48cf-9a52-ef10b7c0779b tempest-CreateVolumesFromSnapshotTest-1181670158 None] Lock "cinder-469d6a6b-2d25-4e1f-b58d-66e8ffb09e33-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:25 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda 1073741824" returned: 0 in 0.474s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:25 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda
Sep 30 18:10:25 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:25 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda" returned: 0 in 0.247s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41222084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73236d1-d912-4a63-8e86-935ba75a30f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bb802c23ba40bcbb5207d8d7b3ecb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:24Z,use_quota=True,user_id='2123a70f85694db49be43fa835ec9337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Creating volume c73236d1-d912-4a63-8e86-935ba75a30f5 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:25 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:25 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5 1073741824
Sep 30 18:10:25 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d66c50-6923-4be5-9a9a-4c79223bdc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0725c9cb-75f4-4164-9b2e-483487dbbf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:25 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Volume volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda (37c336f9-9e94-40a4-a78a-3bc3529e7fda): created successfully
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0725c9cb-75f4-4164-9b2e-483487dbbf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Flow 'volume_create_manager' (fb0b7980-33c5-4838-a975-f7fd00269cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6744a228-132e-4986-80fa-03f070decb24 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created volume successfully.
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-37c336f9-9e94-40a4-a78a-3bc3529e7fda-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-37c336f9-9e94-40a4-a78a-3bc3529e7fda-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-quobyte-37c336f9-9e94-40a4-a78a-3bc3529e7fda" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-37c336f9-9e94-40a4-a78a-3bc3529e7fda" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Flow 'volume_create_manager' (2b0ee763-4cdb-410c-9d7d-aa6c5b57ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b18976b-523b-4e72-acb6-69e95b28ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06383f1-b711-4491-8630-4819dd233e56]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b18976b-523b-4e72-acb6-69e95b28ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034192216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6636a4dc-a30f-4719-8d4b-c63c38b3552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96665c726de4995b6aababd9027edb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:26Z,use_quota=True,user_id='f94fb1240dbd40079170dc0d39ea014d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1b789f-8aac-4446-9971-778e9df89877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1b789f-8aac-4446-9971-778e9df89877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3515857-bbeb-4e51-b530-10867e225d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3515857-bbeb-4e51-b530-10867e225d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6636a4dc-a30f-4719-8d4b-c63c38b3552b', 'volume_name': 'volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:26 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c0a2a-e2e3-46b7-9a5c-3549caa02d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c0a2a-e2e3-46b7-9a5c-3549caa02d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb25b232-ea07-4db5-91b1-9d46fd971d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Volume 6636a4dc-a30f-4719-8d4b-c63c38b3552b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b', 'volume_size': 1}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5 1073741824" returned: 0 in 0.633s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:26 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda
Sep 30 18:10:26 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:26 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5
Sep 30 18:10:26 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:26 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5" returned: 0 in 0.302s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034192216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6636a4dc-a30f-4719-8d4b-c63c38b3552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96665c726de4995b6aababd9027edb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:26Z,use_quota=True,user_id='f94fb1240dbd40079170dc0d39ea014d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Creating volume 6636a4dc-a30f-4719-8d4b-c63c38b3552b {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:26 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:26 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b 1073741824
Sep 30 18:10:26 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d08b3a7-3e26-4570-9bae-f5044c2e9992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73236d1-d912-4a63-8e86-935ba75a30f5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:26 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096b792c-716c-42fc-9293-4d8c5326b935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda" returned: 0 in 0.485s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:26 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Volume volume-c73236d1-d912-4a63-8e86-935ba75a30f5 (c73236d1-d912-4a63-8e86-935ba75a30f5): created successfully
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096b792c-716c-42fc-9293-4d8c5326b935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Flow 'volume_create_manager' (22898f5f-02ea-4257-adca-466e63e43f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:26 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda
Sep 30 18:10:26 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f7549200-cd8e-4014-b852-337f8b3123aa tempest-ProjectReaderTests-1936290260 None] Created volume successfully.
Sep 30 18:10:26 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-37c336f9-9e94-40a4-a78a-3bc3529e7fda" returned: 0 in 0.278s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-37c336f9-9e94-40a4-a78a-3bc3529e7fda" released by "delete_volume" :: held 0.841s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created reservations ['5cace34b-5596-4761-8a83-3f4c42edde6f', '56b9f6d5-f863-4385-89d2-84c7eeae3e18', 'c4040618-e5a9-4fde-b859-6a2928b1ea43', 'c03820ca-78cf-4fe9-b2d3-f3fa0bab51d3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:27 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b 1073741824" returned: 0 in 0.536s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:27 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:27 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:27 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b
Sep 30 18:10:27 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-dc349c20-869b-40e2-826d-cb953d8c796e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-dc349c20-869b-40e2-826d-cb953d8c796e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-quobyte-dc349c20-869b-40e2-826d-cb953d8c796e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-dc349c20-869b-40e2-826d-cb953d8c796e" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391f8c6-79e9-4636-82fe-c4391d4c651b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:27 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.292s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Deleted volume successfully.
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e1624a7c-f4a0-452b-9b41-537ac3a8aa0c tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-37c336f9-9e94-40a4-a78a-3bc3529e7fda-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:27 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e
Sep 30 18:10:27 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:27 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b" returned: 0 in 0.391s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb25b232-ea07-4db5-91b1-9d46fd971d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816d4187-757c-4ce7-ba66-ea4e71b82e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:27 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Volume volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b (6636a4dc-a30f-4719-8d4b-c63c38b3552b): created successfully
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816d4187-757c-4ce7-ba66-ea4e71b82e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Flow 'volume_create_manager' (2b0ee763-4cdb-410c-9d7d-aa6c5b57ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8e894bc2-ef4a-4865-9726-6f53e431fbe9 tempest-ProjectReaderTests-1465481545 None] Created volume successfully.
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-c73236d1-d912-4a63-8e86-935ba75a30f5-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-c73236d1-d912-4a63-8e86-935ba75a30f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "cinder-quobyte-c73236d1-d912-4a63-8e86-935ba75a30f5" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-c73236d1-d912-4a63-8e86-935ba75a30f5" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:27 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e" returned: 0 in 0.429s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c61bf57-76fb-481e-9e9d-99109cf51f16]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:27 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e
Sep 30 18:10:27 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:27 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5
Sep 30 18:10:27 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:28 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-dc349c20-869b-40e2-826d-cb953d8c796e" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-dc349c20-869b-40e2-826d-cb953d8c796e" released by "delete_volume" :: held 0.787s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created reservations ['3ca3589e-5377-4f9e-a4e2-21a0debbd93c', 'b3ebd6c4-9985-478b-a53d-a5c7d9546040', '41cce3f2-b83e-42d2-8c6a-5c9a16cab98d', '432329c2-4314-43cf-9089-e970814d2714'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:28 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5" returned: 0 in 0.448s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:28 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:28 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:28 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:28 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "cinder-6636a4dc-a30f-4719-8d4b-c63c38b3552b-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-6636a4dc-a30f-4719-8d4b-c63c38b3552b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:28 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c73236d1-d912-4a63-8e86-935ba75a30f5" returned: 0 in 0.314s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:28 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-quobyte-c73236d1-d912-4a63-8e86-935ba75a30f5" released by "delete_volume" :: held 0.822s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.313s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-d7f28b76-4d35-4d23-bd4d-6e3647715875-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Deleted volume successfully.
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "cinder-quobyte-6636a4dc-a30f-4719-8d4b-c63c38b3552b" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-d7f28b76-4d35-4d23-bd4d-6e3647715875-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-quobyte-6636a4dc-a30f-4719-8d4b-c63c38b3552b" acquired by "delete_volume" :: waited 0.035s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-5beea9fa-9484-45eb-8ab5-6391df6d227f tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-dc349c20-869b-40e2-826d-cb953d8c796e-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1e3b0-c707-490f-a1e6-83f559ddaf4b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-quobyte-d7f28b76-4d35-4d23-bd4d-6e3647715875" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Created reservations ['4bef1298-8dd8-442a-b298-60d2fec34308', 'e350c309-8f8f-4a69-80d8-2f51a41d07c2', '461a3ae7-fc86-46fb-8af0-b361ad770d46', '558b5268-2f39-4b9a-ae8a-1a599f359a9e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-d7f28b76-4d35-4d23-bd4d-6e3647715875" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce0191-5a9c-49ce-abc8-3ecb195fd947]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:28 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:28 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:29 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875
Sep 30 18:10:29 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:29 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:29 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:29 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:29 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Flow 'volume_create_manager' (f2ed9fe1-18fb-4d9f-bfb6-081b7173f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11101455-be73-442f-a0c8-5e4acd520818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.377s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875" returned: 0 in 0.483s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Deleted volume successfully.
Sep 30 18:10:29 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875
Sep 30 18:10:29 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11101455-be73-442f-a0c8-5e4acd520818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72864158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eefd3c-1025-476b-95a1-455a47a11c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c78d6ffd224293878af7f2968dc379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:29Z,use_quota=True,user_id='8df77df266db48edaffafb350f1e9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:29 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb40376-252c-40ec-9a16-21fe86a88302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb40376-252c-40ec-9a16-21fe86a88302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fcf50a-14fd-42ba-852e-6ac0b8eddec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fcf50a-14fd-42ba-852e-6ac0b8eddec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5eefd3c-1025-476b-95a1-455a47a11c34', 'volume_name': 'volume-d5eefd3c-1025-476b-95a1-455a47a11c34', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92c0c11-5504-462b-8437-0ddd14ab6a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92c0c11-5504-462b-8437-0ddd14ab6a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bcdbaf-4135-4696-bbf0-177f14c8c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:29 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Volume d5eefd3c-1025-476b-95a1-455a47a11c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5eefd3c-1025-476b-95a1-455a47a11c34', 'volume_size': 1}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72864158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eefd3c-1025-476b-95a1-455a47a11c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c78d6ffd224293878af7f2968dc379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:29Z,use_quota=True,user_id='8df77df266db48edaffafb350f1e9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Creating volume d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:29 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b" returned: 0 in 0.690s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:29 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 1073741824
Sep 30 18:10:29 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-63286b66-cc19-488b-a93c-ae96999c0599 tempest-ProjectReaderTests-1936290260 None] Lock "cinder-c73236d1-d912-4a63-8e86-935ba75a30f5-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:29 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b
Sep 30 18:10:29 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:29 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d7f28b76-4d35-4d23-bd4d-6e3647715875" returned: 0 in 0.267s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-d7f28b76-4d35-4d23-bd4d-6e3647715875" released by "delete_volume" :: held 0.816s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created reservations ['96695d74-0af1-4ee1-a3c5-bb6d75aaa8b3', '69aa1a9c-a351-4706-be41-bfa0ea27ad02', '48f57a70-8fdb-462c-b8b2-bbfdb7c16a1a', 'fbdd1545-2f57-4d60-8c41-55e45cf66c2c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:29 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-6636a4dc-a30f-4719-8d4b-c63c38b3552b" returned: 0 in 0.328s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:29 devstack sudo[107561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:29 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-quobyte-6636a4dc-a30f-4719-8d4b-c63c38b3552b" released by "delete_volume" :: held 1.098s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Created reservations ['e18442e4-e80f-4020-9aa0-edc4d52ac9f5', 'b81df2da-bd08-48ca-a620-96458abf6860', '26ed8928-19b6-4383-9782-631545110daa', '7638e1df-1fe7-4576-93de-7a199671337f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:30 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 1073741824" returned: 0 in 0.693s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-quobyte-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:30 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.423s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:30 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:30 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Deleted volume successfully.
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d" acquired by "delete_volume" :: waited 0.064s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-8ed98cc1-0d16-4f32-84e9-c586a632fbc2 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-d7f28b76-4d35-4d23-bd4d-6e3647715875-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8c53c-d51e-44d8-835d-e3e14375c992]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:30 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34
Sep 30 18:10:30 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:30 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d
Sep 30 18:10:30 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:30 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Deleted volume successfully.
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-0f97a01a-00f3-44e9-aed7-41fec85dfb50 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-6636a4dc-a30f-4719-8d4b-c63c38b3552b-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:30 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34" returned: 0 in 0.358s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bcdbaf-4135-4696-bbf0-177f14c8c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5eefd3c-1025-476b-95a1-455a47a11c34', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfb7b09-8d2a-49e4-ac2f-1b579e1ea032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:30 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Volume volume-d5eefd3c-1025-476b-95a1-455a47a11c34 (d5eefd3c-1025-476b-95a1-455a47a11c34): created successfully
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfb7b09-8d2a-49e4-ac2f-1b579e1ea032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Flow 'volume_create_manager' (f2ed9fe1-18fb-4d9f-bfb6-081b7173f510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-03668733-d4f4-4ec9-b6ec-b03cb93aa02b tempest-VolumeDependencyTests-201489313 None] Created volume successfully.
Sep 30 18:10:30 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d" returned: 0 in 0.467s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:30 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d
Sep 30 18:10:30 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:31 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d" returned: 0 in 0.283s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d" released by "delete_volume" :: held 0.826s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created reservations ['9f74badd-ce2c-45f2-ab78-abea603f5991', '273411e8-e9f0-4c08-b2b0-4e0453ae5d5b', 'cbd9bab3-35bb-4584-a212-4308cddb867a', '40a8ebaf-7194-493c-8b7f-fed90f9ea288'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:31 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:31 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:31 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.355s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Deleted volume successfully.
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1abad80e-67e4-4a36-ac0d-6c8724d71c7a tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-df4379ce-f4d8-4b8f-a8ca-7c9c5931bf1d-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Flow 'volume_create_manager' (edc626ac-5b76-4b1e-9a69-e3d131200acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0c8a2b-110a-4f0e-a897-43b3013a60ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Creating offline snapshot 9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 of volume d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0c8a2b-110a-4f0e-a897-43b3013a60ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491932208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe10cf8-6260-4a0e-80cc-4f7198a885c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96665c726de4995b6aababd9027edb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:32Z,use_quota=True,user_id='f94fb1240dbd40079170dc0d39ea014d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3bb2ec-eac9-4754-8014-f0c056c58c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3bb2ec-eac9-4754-8014-f0c056c58c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993e05e-8a42-4b70-aace-3a94a114acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993e05e-8a42-4b70-aace-3a94a114acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe10cf8-6260-4a0e-80cc-4f7198a885c3', 'volume_name': 'volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c58aaa4-87c5-4ad1-a5e9-bdb13dade154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c58aaa4-87c5-4ad1-a5e9-bdb13dade154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e01f6c-6903-4060-a979-38ec98dc06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Volume 1fe10cf8-6260-4a0e-80cc-4f7198a885c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3', 'volume_size': 1}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc736c5d-23c8-4ab4-8930-7b46481a726e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:31 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34
Sep 30 18:10:31 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:32 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:32 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 1G
Sep 30 18:10:32 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-21b5e6ad-b45f-43ec-8018-aa5c20b8faca-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-21b5e6ad-b45f-43ec-8018-aa5c20b8faca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-quobyte-21b5e6ad-b45f-43ec-8018-aa5c20b8faca" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-21b5e6ad-b45f-43ec-8018-aa5c20b8faca" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[141f0ba5-6bb5-47a6-adff-6e9a0e002af4]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:32 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca
Sep 30 18:10:32 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:32 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 1G" returned: 0 in 0.423s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5eefd3c-1025-476b-95a1-455a47a11c34 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:32 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5eefd3c-1025-476b-95a1-455a47a11c34 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8
Sep 30 18:10:32 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:32 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca" returned: 0 in 0.401s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:32 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca
Sep 30 18:10:32 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:32 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5eefd3c-1025-476b-95a1-455a47a11c34 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" returned: 0 in 0.310s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:32 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 is being set with open permissions: ugo+rw
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:32 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8
Sep 30 18:10:32 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:32 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-21b5e6ad-b45f-43ec-8018-aa5c20b8faca" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-21b5e6ad-b45f-43ec-8018-aa5c20b8faca" released by "delete_volume" :: held 0.707s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created reservations ['6f3fdd12-2a2d-4d69-bc2c-a81633981749', '953480bc-edec-49cf-83bf-e22931165a12', '957d0aea-6c9e-4a15-b21f-88802330d806', '3e1d52a0-9ff0-4ded-a66c-5eccacf7d6c0'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:33 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:33 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info
Sep 30 18:10:33 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:33 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:33 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-99308f29-1464-47d8-b7cc-5602dedd2cab-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:33 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:33 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:33 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info is being set with open permissions: ugo+rw
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Deleted volume successfully.
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-99308f29-1464-47d8-b7cc-5602dedd2cab-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:33 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info
Sep 30 18:10:33 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5bbc291-e428-4914-b321-96199a562f62 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-21b5e6ad-b45f-43ec-8018-aa5c20b8faca-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "cinder-quobyte-99308f29-1464-47d8-b7cc-5602dedd2cab" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-99308f29-1464-47d8-b7cc-5602dedd2cab" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[84663fcd-cadc-47c2-98fb-c77ad455cc61]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:33 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab
Sep 30 18:10:33 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:33 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.info" returned: 0 in 0.283s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.953s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491932208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe10cf8-6260-4a0e-80cc-4f7198a885c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96665c726de4995b6aababd9027edb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:32Z,use_quota=True,user_id='f94fb1240dbd40079170dc0d39ea014d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Creating volume 1fe10cf8-6260-4a0e-80cc-4f7198a885c3 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:33 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:33 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 1073741824
Sep 30 18:10:33 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f3319c3e-7f01-4603-ae8b-06d6959a7e05 tempest-VolumeDependencyTests-201489313 None] Create snapshot completed successfully
Sep 30 18:10:33 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab" returned: 0 in 0.372s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:33 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab
Sep 30 18:10:33 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:34 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 1073741824" returned: 0 in 0.416s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:34 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-99308f29-1464-47d8-b7cc-5602dedd2cab" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-quobyte-99308f29-1464-47d8-b7cc-5602dedd2cab" released by "delete_volume" :: held 0.674s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:34 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3
Sep 30 18:10:34 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Created reservations ['fd92f887-8102-4140-895a-1c4c2446bb9f', '6b3623be-96fe-424e-867b-2ce84817a8ff', '4c7482b6-6595-46ed-b21d-d939188cc24c', 'fc729e01-3b6c-4f16-81d4-441dfae13fd4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:34 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:34 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:34 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3" returned: 0 in 0.244s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e01f6c-6903-4060-a979-38ec98dc06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727013d-6f0d-42c0-a584-68b0d7dfe14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:34 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Volume volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 (1fe10cf8-6260-4a0e-80cc-4f7198a885c3): created successfully
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727013d-6f0d-42c0-a584-68b0d7dfe14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Flow 'volume_create_manager' (edc626ac-5b76-4b1e-9a69-e3d131200acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e8ab5bd9-6666-4411-ab98-d28ce319d98c tempest-ProjectReaderTests-1465481545 None] Created volume successfully.
Sep 30 18:10:34 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:34 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Deleted volume successfully.
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2f0c786f-8872-4993-aa2f-7ec8af292d47 tempest-CreateVolumesFromSourceVolumeTest-169363986 None] Lock "cinder-99308f29-1464-47d8-b7cc-5602dedd2cab-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "cinder-1fe10cf8-6260-4a0e-80cc-4f7198a885c3-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-1fe10cf8-6260-4a0e-80cc-4f7198a885c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "cinder-quobyte-1fe10cf8-6260-4a0e-80cc-4f7198a885c3" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-quobyte-1fe10cf8-6260-4a0e-80cc-4f7198a885c3" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[686918b3-8a2e-4677-af33-e2454ad5e880]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:35 devstack sudo[107639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3
Sep 30 18:10:35 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Flow 'volume_create_manager' (95156789-cdb4-4de4-8366-0bf581198eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb418536-9691-48f8-974d-d4c5b7fe9447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb418536-9691-48f8-974d-d4c5b7fe9447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2067066111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05ef7cd-225e-4db1-957c-0aafc4db9219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c78d6ffd224293878af7f2968dc379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c4009ce-8e16-4c6d-ab56-5a18bc8358d8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:35Z,use_quota=True,user_id='8df77df266db48edaffafb350f1e9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcf6053-413c-41a8-aa1a-ad1ff053bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcf6053-413c-41a8-aa1a-ad1ff053bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:35 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6c6f9e-e007-489e-9c75-2e52e9274c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6c6f9e-e007-489e-9c75-2e52e9274c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd05ef7cd-225e-4db1-957c-0aafc4db9219', 'volume_name': 'volume-d05ef7cd-225e-4db1-957c-0aafc4db9219', 'volume_size': 1, 'snapshot_id': '9c4009ce-8e16-4c6d-ab56-5a18bc8358d8'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f7e651-635e-45b7-96c5-e93301204de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f7e651-635e-45b7-96c5-e93301204de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b37a69b-cc79-42cb-92ec-9294cd8e9797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:35 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Volume d05ef7cd-225e-4db1-957c-0aafc4db9219: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d05ef7cd-225e-4db1-957c-0aafc4db9219', 'volume_size': 1, 'snapshot_id': '9c4009ce-8e16-4c6d-ab56-5a18bc8358d8'}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3" returned: 0 in 0.514s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-quobyte-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8-d05ef7cd-225e-4db1-957c-0aafc4db9219" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:35 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3
Sep 30 18:10:35 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8-d05ef7cd-225e-4db1-957c-0aafc4db9219" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Creating volume d05ef7cd-225e-4db1-957c-0aafc4db9219 from snapshot 9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-quobyte-d05ef7cd-225e-4db1-957c-0aafc4db9219" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d05ef7cd-225e-4db1-957c-0aafc4db9219" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] snapshot: 9c4009ce-8e16-4c6d-ab56-5a18bc8358d8, volume: d05ef7cd-225e-4db1-957c-0aafc4db9219,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a185814-4cd3-4ad9-bf42-c73527fbdc84]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:35 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8
Sep 30 18:10:35 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:35 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-1fe10cf8-6260-4a0e-80cc-4f7198a885c3" returned: 0 in 0.289s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-quobyte-1fe10cf8-6260-4a0e-80cc-4f7198a885c3" released by "delete_volume" :: held 0.859s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Created reservations ['b065c777-4d7f-428b-8adb-d11757e60f7c', '592eae3e-fbe6-4197-80bd-3b83b0ecb430', '196e0ad7-616b-443b-8067-fd5ab510429f', 'bc5c9eb1-ff31-44d7-964a-da671cc7f1d0'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:35 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:35 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:36 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" returned: 0 in 0.468s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5eefd3c-1025-476b-95a1-455a47a11c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[beece422-ac46-4e9a-8ce2-71e59bd7c929]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:36 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.309s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:36 devstack sudo[107654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34
Sep 30 18:10:36 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Deleted volume successfully.
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ff4ddc7b-ef4e-460a-be1a-5947486ce5c4 tempest-ProjectReaderTests-1465481545 None] Lock "cinder-1fe10cf8-6260-4a0e-80cc-4f7198a885c3-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:36 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:10:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:36 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219
Sep 30 18:10:36 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Flow 'volume_create_manager' (85b46cc2-2ea5-4d26-9081-c46dfde437c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f9de3b-d71f-4fcc-9e16-68d374ffad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f9de3b-d71f-4fcc-9e16-68d374ffad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239f6d82e9dc4a92ba5819a71ebb19e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:43Z,use_quota=True,user_id='e2c564cb1ca44ca992531e4a0202d001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaa3a1d-fa5c-43f6-91c1-503fdb6588c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaa3a1d-fa5c-43f6-91c1-503fdb6588c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a4eb57-ca5a-4834-821a-6e278551a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:43 devstack cinder-volume[87418]: DEBUG cinder.image.glance [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Creating Keystone auth plugin from conf {{(pid=87418) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a4eb57-ca5a-4834-821a-6e278551a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f', 'volume_name': 'volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f', 'volume_size': 1, 'image_id': '46622bbf-6433-466c-ba54-8d45624a595d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46622bbf-6433-466c-ba54-8d45624a595d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8330d0c94e22538e49c169b0525fe30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '239f6d82e9dc4a92ba5819a71ebb19e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '108a6cf948ae020f09d86686bd5c44037cc32ebe6adce70b933617036b2ba76c93668d291b7bd87259f49da980ef8945a2a8b1b342cacee4f3d9f05c638e3880', 'id': '46622bbf-6433-466c-ba54-8d45624a595d', 'created_at': datetime.datetime(2026, 9, 30, 16, 10, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 10, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46622bbf-6433-466c-ba54-8d45624a595d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1496f3530>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2d22b9-57ae-4d18-8117-b3b7b30a8649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2d22b9-57ae-4d18-8117-b3b7b30a8649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cc5456-1d5a-4231-8769-32b1541c444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:44 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Volume b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f', 'volume_size': 1, 'image_id': '46622bbf-6433-466c-ba54-8d45624a595d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46622bbf-6433-466c-ba54-8d45624a595d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8330d0c94e22538e49c169b0525fe30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '239f6d82e9dc4a92ba5819a71ebb19e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '108a6cf948ae020f09d86686bd5c44037cc32ebe6adce70b933617036b2ba76c93668d291b7bd87259f49da980ef8945a2a8b1b342cacee4f3d9f05c638e3880', 'id': '46622bbf-6433-466c-ba54-8d45624a595d', 'created_at': datetime.datetime(2026, 9, 30, 16, 10, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 10, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46622bbf-6433-466c-ba54-8d45624a595d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1496f3530>}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Trying to clone b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f from image 46622bbf-6433-466c-ba54-8d45624a595d at location (None, [{'url': 'file:///opt/stack/data/glance/images/46622bbf-6433-466c-ba54-8d45624a595d', 'metadata': {}}]). {{(pid=87418) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 30 18:10:44 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad99fd-56e0-46af-86f0-d95fffd4f18f]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:44 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219" returned: 0 in 8.015s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:10:44 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Converted 1024.00 MB image at 127.73 MB/s
Sep 30 18:10:44 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 is being set with open permissions: ugo+rw
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:44 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219
Sep 30 18:10:44 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:44 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD
Sep 30 18:10:44 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:44 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219" returned: 0 in 0.272s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d05ef7cd-225e-4db1-957c-0aafc4db9219" released by "_copy_volume_from_snapshot" :: held 9.301s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:44 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8-d05ef7cd-225e-4db1-957c-0aafc4db9219" released by "_create_volume_from_snapshot" :: held 9.378s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.399s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b37a69b-cc79-42cb-92ec-9294cd8e9797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05ef7cd-225e-4db1-957c-0aafc4db9219', 'volume_size': 1, 'snapshot_id': '9c4009ce-8e16-4c6d-ab56-5a18bc8358d8'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52a261b-c13a-42d4-8f32-5237aa7324f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:44 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Volume volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 (d05ef7cd-225e-4db1-957c-0aafc4db9219): created successfully
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52a261b-c13a-42d4-8f32-5237aa7324f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:44 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Flow 'volume_create_manager' (95156789-cdb4-4de4-8366-0bf581198eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-20cb9839-a442-4214-a1bf-9ac1e5a9b489 tempest-VolumeDependencyTests-201489313 None] Created volume successfully.
Sep 30 18:10:44 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD
Sep 30 18:10:44 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:45 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Temporary image 46622bbf-6433-466c-ba54-8d45624a595d is fetched for user e2c564cb1ca44ca992531e4a0202d001. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e5621d-9ce4-4184-8852-3a09e23883e3]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-quobyte-d5eefd3c-1025-476b-95a1-455a47a11c34" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d5eefd3c-1025-476b-95a1-455a47a11c34" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-quobyte-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Deleting offline snapshot 9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 of volume d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] snapshot_file for this snap is: volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[666dc0e8-dda0-4791-927f-772b356680b8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:45 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD
Sep 30 18:10:45 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:45 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8
Sep 30 18:10:45 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:45 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:45 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD
Sep 30 18:10:45 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:45 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" returned: 0 in 0.438s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5eefd3c-1025-476b-95a1-455a47a11c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e0245-7162-43d7-8b2f-d199436af854]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:45 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34
Sep 30 18:10:45 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:46 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239f6d82e9dc4a92ba5819a71ebb19e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:43Z,use_quota=True,user_id='e2c564cb1ca44ca992531e4a0202d001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Creating volume b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:46 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:46 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f 1073741824
Sep 30 18:10:46 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:46 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34" returned: 0 in 0.581s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:46 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:46 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:46 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8
Sep 30 18:10:46 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:46 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f 1073741824" returned: 0 in 0.493s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:46 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f
Sep 30 18:10:46 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:46 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.289s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:10:46 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" returned: 0 in 0.270s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:46 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" returned: 0 in 0.416s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:46 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Attempting download of 46622bbf-6433-466c-ba54-8d45624a595d ((None, [{'url': 'file:///opt/stack/data/glance/images/46622bbf-6433-466c-ba54-8d45624a595d', 'metadata': {}}])) to volume b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 30 18:10:46 devstack sudo[107731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8
Sep 30 18:10:46 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[318a52cf-20dc-4b26-a2fe-8eaf0fe12788]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:47 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3
Sep 30 18:10:47 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:47 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34.9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" returned: 0 in 0.384s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8" released by "_delete_snapshot" :: held 2.007s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d5eefd3c-1025-476b-95a1-455a47a11c34" released by "delete_snapshot" :: held 2.035s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:47 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3" returned: 0 in 0.390s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Created reservations ['1ac1dafe-1843-4fae-9e0f-f2c9a93b1d96', '430bf449-49ca-4a57-b4c6-13e76436866d', 'bc173a12-b190-4183-bbbf-3b9ba0899cad', '58c6fcb0-6f15-4e10-94b9-588458a4d59e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Delete snapshot completed successfully.
Sep 30 18:10:47 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3
Sep 30 18:10:47 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-4c4fbc9a-1667-4cdb-8077-303c68cb1351 tempest-VolumeDependencyTests-201489313 None] Lock "cinder-9c4009ce-8e16-4c6d-ab56-5a18bc8358d8-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:47 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3" returned: 1 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46622bbf-6433-466c-ba54-8d45624a595d_i1v_rrm3' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117b7c4-69aa-4d37-914e-3bed2d543026]: (4, 'raw') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:47 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD
Sep 30 18:10:47 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:48 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:48 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD
Sep 30 18:10:48 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:48 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-d5eefd3c-1025-476b-95a1-455a47a11c34-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] 46622bbf-6433-466c-ba54-8d45624a595d was raw, converting to qcow2 {{(pid=87418) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Lock "cinder-d5eefd3c-1025-476b-95a1-455a47a11c34-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:48 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f
Sep 30 18:10:48 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-quobyte-d5eefd3c-1025-476b-95a1-455a47a11c34" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d5eefd3c-1025-476b-95a1-455a47a11c34" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e328948-7315-43a8-9921-2e2b46af22ad]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:48 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34
Sep 30 18:10:48 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:49 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" returned: 0 in 0.620s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46622bbf-6433-466c-ba54-8d45624a595d_ppzl18o5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:10:49 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:49 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f 1G
Sep 30 18:10:49 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:49 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34" returned: 0 in 0.499s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:49 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34
Sep 30 18:10:49 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:49 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d5eefd3c-1025-476b-95a1-455a47a11c34" returned: 0 in 0.298s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d5eefd3c-1025-476b-95a1-455a47a11c34" released by "delete_volume" :: held 0.888s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=198,cinder:UPDATE=299,cinder:DELETE=25,cinder:INSERT=68 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=279,cinder:SELECT=208,cinder:INSERT=76,cinder:DELETE=27 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:10:49 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f 1G" returned: 0 in 0.410s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Downloaded image 46622bbf-6433-466c-ba54-8d45624a595d ((None, [{'url': 'file:///opt/stack/data/glance/images/46622bbf-6433-466c-ba54-8d45624a595d', 'metadata': {}}])) to volume b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f successfully. {{(pid=87418) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Temporary image 46622bbf-6433-466c-ba54-8d45624a595d for user e2c564cb1ca44ca992531e4a0202d001 is deleted. {{(pid=87418) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.volume_utils [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Marking volume b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f as bootable. {{(pid=87418) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Copying metadata from image 46622bbf-6433-466c-ba54-8d45624a595d to b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f. {{(pid=87418) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Creating volume glance metadata for volume b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f backed by image 46622bbf-6433-466c-ba54-8d45624a595d with: {'image_id': '46622bbf-6433-466c-ba54-8d45624a595d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd8330d0c94e22538e49c169b0525fe30', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87418) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Created reservations ['d88f7320-24e5-499f-b83c-8e086128a189', 'bdf633bd-2095-4d69-aaa6-f5d88b2fb1d9', 'd0d7f6ad-af01-48c1-b731-cca3ccfb13eb', '1fc2c892-9bf3-4eb3-9ac5-e0499d6b6eb7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cc5456-1d5a-4231-8769-32b1541c444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f', 'volume_size': 1, 'image_id': '46622bbf-6433-466c-ba54-8d45624a595d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46622bbf-6433-466c-ba54-8d45624a595d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8330d0c94e22538e49c169b0525fe30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '239f6d82e9dc4a92ba5819a71ebb19e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '108a6cf948ae020f09d86686bd5c44037cc32ebe6adce70b933617036b2ba76c93668d291b7bd87259f49da980ef8945a2a8b1b342cacee4f3d9f05c638e3880', 'id': '46622bbf-6433-466c-ba54-8d45624a595d', 'created_at': datetime.datetime(2026, 9, 30, 16, 10, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 16, 10, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46622bbf-6433-466c-ba54-8d45624a595d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73c1496f3530>}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405dfc45-127d-46fe-b3b4-1510e3aa4116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:49 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Volume volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f (b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f): created successfully
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405dfc45-127d-46fe-b3b4-1510e3aa4116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:49 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Flow 'volume_create_manager' (85b46cc2-2ea5-4d26-9081-c46dfde437c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:49 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:49 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:49 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-84229b52-8618-49ca-8c10-bd322592f9ab tempest-VolumeImageDependencyTests-992697494 None] Created volume successfully.
Sep 30 18:10:50 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.270s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Deleted volume successfully.
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fc7b3cd9-d015-4e31-a324-c5721f55ef4a tempest-VolumeDependencyTests-201489313 None] Lock "cinder-d5eefd3c-1025-476b-95a1-455a47a11c34-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-d05ef7cd-225e-4db1-957c-0aafc4db9219-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Lock "cinder-d05ef7cd-225e-4db1-957c-0aafc4db9219-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Acquiring lock "cinder-quobyte-d05ef7cd-225e-4db1-957c-0aafc4db9219" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d05ef7cd-225e-4db1-957c-0aafc4db9219" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbea92e-da8a-4b2f-881b-86b344c80828]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:51 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219
Sep 30 18:10:51 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Acquiring lock "cinder-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Lock "cinder-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Acquiring lock "cinder-quobyte-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Lock "cinder-quobyte-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb576e0-7dca-4a4a-97d1-9e56242beb5f]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:51 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f
Sep 30 18:10:51 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:51 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219" returned: 0 in 0.521s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:51 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219
Sep 30 18:10:51 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:51 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" returned: 0 in 0.496s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:51 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d05ef7cd-225e-4db1-957c-0aafc4db9219" returned: 0 in 0.332s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:51 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f
Sep 30 18:10:51 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Lock "cinder-quobyte-d05ef7cd-225e-4db1-957c-0aafc4db9219" released by "delete_volume" :: held 0.926s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Created reservations ['df7f0a7a-575a-484f-8e83-6d983ae0e470', '208c1da4-e326-4685-9671-3e05c4b3d7b0', '7af2c153-d4e4-46ee-9507-79bd5dfc816e', '7e08b5e1-91f6-46ea-86cb-8e03cf8de825'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:52 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:52 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:52 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" returned: 0 in 0.467s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Lock "cinder-quobyte-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f" released by "delete_volume" :: held 1.061s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:52 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.346s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Deleted volume successfully.
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-98c037c9-c1aa-4447-8de0-dd53c05942ba tempest-VolumeDependencyTests-201489313 None] Lock "cinder-d05ef7cd-225e-4db1-957c-0aafc4db9219-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Created reservations ['58b7150e-d22d-44c0-8af7-6afbef082395', '849d3457-e722-4b48-b864-b1b0317ba89b', '74538a2d-411a-4df2-b265-52e669b88308', 'ef4f0187-ec6f-4751-9ea8-8875d468f353'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:52 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:10:52 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:52 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:10:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Deleted volume successfully.
Sep 30 18:10:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e97063a6-ccc2-421d-993f-0ec42288385a tempest-VolumeImageDependencyTests-992697494 None] Lock "cinder-b19b5c7d-4acc-49fe-b12a-ed4acdcfb37f-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Flow 'volume_create_manager' (037676c4-182e-4a8d-bf88-46fc748fe8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd88469b-04ae-430f-b4ff-4b4fbdea056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd88469b-04ae-430f-b4ff-4b4fbdea056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda0ba24-43c6-4220-85d0-bb391d46d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ce3c7f712c4de48b1c980f8aa41e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:57Z,use_quota=True,user_id='ed94a048964d4c49baa09a179f204e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e7c207-2b9f-4ffd-b565-ab0ced9ed089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e7c207-2b9f-4ffd-b565-ab0ced9ed089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bad3a3-97d5-4b2a-a233-4a5017d99381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bad3a3-97d5-4b2a-a233-4a5017d99381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda0ba24-43c6-4220-85d0-bb391d46d3dc', 'volume_name': 'volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5fa19-d79e-4300-abf3-bd7eea5750e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5fa19-d79e-4300-abf3-bd7eea5750e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f829e-c660-4d12-bdf4-8a18e66d045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:57 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Volume cda0ba24-43c6-4220-85d0-bb391d46d3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc', 'volume_size': 1}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda0ba24-43c6-4220-85d0-bb391d46d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ce3c7f712c4de48b1c980f8aa41e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:10:57Z,use_quota=True,user_id='ed94a048964d4c49baa09a179f204e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Creating volume cda0ba24-43c6-4220-85d0-bb391d46d3dc {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:10:57 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:57 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc 1073741824
Sep 30 18:10:57 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:57 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc 1073741824" returned: 0 in 0.652s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:10:58 devstack sudo[107840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc
Sep 30 18:10:58 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:10:58 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc" returned: 0 in 0.310s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f829e-c660-4d12-bdf4-8a18e66d045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce774df-921e-4fad-b209-18851e996a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:58 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Volume volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc (cda0ba24-43c6-4220-85d0-bb391d46d3dc): created successfully
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce774df-921e-4fad-b209-18851e996a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:58 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Flow 'volume_create_manager' (037676c4-182e-4a8d-bf88-46fc748fe8d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:58 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-123a0c21-df88-4656-82a4-22f7f35412b1 tempest-CinderUnicodeTest-1625744984 None] Created volume successfully.
Sep 30 18:10:59 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:10:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Flow 'volume_create_manager' (d9b4eade-0335-40a7-b90e-daca184dea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:10:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fc2f55-2bc9-4cb3-b7c8-a1398b1604a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:10:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fc2f55-2bc9-4cb3-b7c8-a1398b1604a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-420500794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ce3c7f712c4de48b1c980f8aa41e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:00Z,use_quota=True,user_id='ed94a048964d4c49baa09a179f204e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:10:59 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3d13b-6fd1-4cd4-b0e1-7b8f92c360a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3d13b-6fd1-4cd4-b0e1-7b8f92c360a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6692c817-314f-4119-9798-c93d3fdf46e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6692c817-314f-4119-9798-c93d3fdf46e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0', 'volume_name': 'volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e97377-6499-4784-954e-aa8d4fedf2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e97377-6499-4784-954e-aa8d4fedf2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4138d4de-3f86-4c20-8c82-3ce863e31fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:00 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Volume 09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0', 'volume_size': 1}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-420500794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ce3c7f712c4de48b1c980f8aa41e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:00Z,use_quota=True,user_id='ed94a048964d4c49baa09a179f204e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Creating volume 09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:00 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:00 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 1073741824
Sep 30 18:11:00 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:00 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 1073741824" returned: 0 in 0.601s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:00 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0
Sep 30 18:11:00 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:01 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" returned: 0 in 0.308s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4138d4de-3f86-4c20-8c82-3ce863e31fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1206ad-290d-4eb2-9f38-b540d5bbcd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:01 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Volume volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 (09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0): created successfully
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1206ad-290d-4eb2-9f38-b540d5bbcd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:01 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Flow 'volume_create_manager' (d9b4eade-0335-40a7-b90e-daca184dea79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:01 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-5a3669e2-173a-45c7-b088-22efd4f661ab tempest-CinderUnicodeTest-1625744984 None] Created volume successfully.
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Creating offline snapshot 50390540-7b8b-47fc-a544-f0bbf58a32f9 of volume 09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00fd8a-2dc0-494a-b913-473fcf084c40]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:02 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0
Sep 30 18:11:02 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:02 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" returned: 0 in 0.487s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:02 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 1G
Sep 30 18:11:02 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:03 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 1G" returned: 0 in 0.544s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:03 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9
Sep 30 18:11:03 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:03 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9" returned: 0 in 0.345s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:03 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 is being set with open permissions: ugo+rw
Sep 30 18:11:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:03 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9
Sep 30 18:11:03 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:03 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9" returned: 0 in 0.292s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:04 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info
Sep 30 18:11:04 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:04 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info" returned: 0 in 0.367s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:04 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info is being set with open permissions: ugo+rw
Sep 30 18:11:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:04 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info
Sep 30 18:11:04 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:04 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.info" returned: 0 in 0.279s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:04 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b34b1c7a-d2ed-40f8-a346-7864cf8c6d8b tempest-CinderUnicodeTest-1625744984 None] Create snapshot completed successfully
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-50390540-7b8b-47fc-a544-f0bbf58a32f9-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-50390540-7b8b-47fc-a544-f0bbf58a32f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-quobyte-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-quobyte-50390540-7b8b-47fc-a544-f0bbf58a32f9" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-50390540-7b8b-47fc-a544-f0bbf58a32f9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Deleting offline snapshot 50390540-7b8b-47fc-a544-f0bbf58a32f9 of volume 09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] snapshot_file for this snap is: volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91eb39d-365c-4bb1-aa09-53a10886fe93]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Flow 'volume_create_manager' (9e8edfc8-54b4-4344-8981-78c207aa5150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5a75e-fad2-4878-a808-eb2a179fcbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5a75e-fad2-4878-a808-eb2a179fcbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1628883945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9b26e4-7c86-460a-b7c2-9d493c9e87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97446782ecc949d18fd0d15168a1c207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:06Z,use_quota=True,user_id='6a3abb1d2e0748b6a50aa955d5401476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e040b571-b73e-4b14-8ab1-c308915b75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e040b571-b73e-4b14-8ab1-c308915b75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7feaf753-8ce5-4ace-bcf4-a73d9ff71246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7feaf753-8ce5-4ace-bcf4-a73d9ff71246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9b26e4-7c86-460a-b7c2-9d493c9e87e7', 'volume_name': 'volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0fae02-d93e-4a6f-aa50-65ad3f61ee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0fae02-d93e-4a6f-aa50-65ad3f61ee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:05 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9
Sep 30 18:11:05 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92d9ae5-42f7-4d70-a42a-32c513811a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:05 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Volume ff9b26e4-7c86-460a-b7c2-9d493c9e87e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7', 'volume_size': 1}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1628883945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9b26e4-7c86-460a-b7c2-9d493c9e87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97446782ecc949d18fd0d15168a1c207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:06Z,use_quota=True,user_id='6a3abb1d2e0748b6a50aa955d5401476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Creating volume ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:05 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:05 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 1073741824
Sep 30 18:11:05 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:06 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9" returned: 0 in 0.386s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc1891f-8d6f-411d-8f7d-ce23399b7c94]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:06 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0
Sep 30 18:11:06 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:06 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 1073741824" returned: 0 in 0.531s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:06 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7
Sep 30 18:11:06 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:06 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (650c18c5-24ee-4ee1-9f51-b7ebbaf565bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762f058e-d6f8-46ad-aa56-406711316e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" returned: 0 in 0.456s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762f058e-d6f8-46ad-aa56-406711316e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701407550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d378996f-8cd0-4583-b368-ddce13890453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:06Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:06 devstack sudo[107897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f186362-b41b-42a7-82c0-aa84393eb605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:06 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f186362-b41b-42a7-82c0-aa84393eb605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8349405c-1628-4eb8-b8b1-3e3f52da53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8349405c-1628-4eb8-b8b1-3e3f52da53a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd378996f-8cd0-4583-b368-ddce13890453', 'volume_name': 'volume-d378996f-8cd0-4583-b368-ddce13890453', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510aaba7-c8fb-4d77-bcc2-f590015b5d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510aaba7-c8fb-4d77-bcc2-f590015b5d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19fdee9-7a0b-4469-aa58-f10dd1201818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Volume d378996f-8cd0-4583-b368-ddce13890453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d378996f-8cd0-4583-b368-ddce13890453', 'volume_size': 1}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:06 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701407550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d378996f-8cd0-4583-b368-ddce13890453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:06Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Creating volume d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:06 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92d9ae5-42f7-4d70-a42a-32c513811a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dfc081-40f8-41b4-a46a-ab2b487ab1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:06 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 1073741824
Sep 30 18:11:06 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:06 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Volume volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 (ff9b26e4-7c86-460a-b7c2-9d493c9e87e7): created successfully
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dfc081-40f8-41b4-a46a-ab2b487ab1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Flow 'volume_create_manager' (9e8edfc8-54b4-4344-8981-78c207aa5150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:06 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-19f89a7c-7eb5-42d2-9010-68e4a003aeb2 tempest-SnapshotDependencyTests-1205611697 None] Created volume successfully.
Sep 30 18:11:06 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9" returned: 0 in 0.363s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:06 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:06 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9
Sep 30 18:11:06 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:07 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 1073741824" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:07 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0.50390540-7b8b-47fc-a544-f0bbf58a32f9" returned: 0 in 0.259s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:07 devstack sudo[107911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453
Sep 30 18:11:07 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-50390540-7b8b-47fc-a544-f0bbf58a32f9" released by "_delete_snapshot" :: held 1.593s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" released by "delete_snapshot" :: held 1.619s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Created reservations ['192fc06f-0450-425c-ab3e-21cda99ae26c', 'ef25affc-9b9f-4145-abd7-7b60acffbb7b', '186c43e7-07c1-4563-95cf-b6312f2effaf', 'f1dfce23-c24c-4a55-adac-d3294fa924e6'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Delete snapshot completed successfully.
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7e6c0f41-e122-4aeb-8e91-66ab0243d2d8 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-50390540-7b8b-47fc-a544-f0bbf58a32f9-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:07 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453" returned: 0 in 0.242s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19fdee9-7a0b-4469-aa58-f10dd1201818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d378996f-8cd0-4583-b368-ddce13890453', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfcedea-ffbe-4d45-b1e1-8d6b41234a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:07 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Volume volume-d378996f-8cd0-4583-b368-ddce13890453 (d378996f-8cd0-4583-b368-ddce13890453): created successfully
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfcedea-ffbe-4d45-b1e1-8d6b41234a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (650c18c5-24ee-4ee1-9f51-b7ebbaf565bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:07 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2e98e5c4-ca31-4795-babc-c065c9b20eb1 tempest-ProjectReaderTests-1444058996 None] Created volume successfully.
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Creating offline snapshot 65ccad12-d197-43f3-aa1b-4517746d1a42 of volume d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b0ed63-c4c0-4551-8bba-f3395ba0a1ac]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-quobyte-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cbadb0-20dd-43e8-8b9b-15683efe5d7e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:07 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453
Sep 30 18:11:07 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0
Sep 30 18:11:08 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:08 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453" returned: 0 in 0.427s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:08 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 1G
Sep 30 18:11:08 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" returned: 0 in 0.387s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:08 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0
Sep 30 18:11:08 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0" released by "delete_volume" :: held 0.728s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:08 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Created reservations ['c091cc6a-17e3-46fd-969c-a966e7ea0653', 'f282a38a-b61f-4b1e-b78b-1cadc625ab45', '9c36f46e-f9de-40cb-9b10-f7ad4a4408f9', '728615bc-9f3e-4f03-947c-c1585c346159'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 1G" returned: 0 in 0.419s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d378996f-8cd0-4583-b368-ddce13890453 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:08 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d378996f-8cd0-4583-b368-ddce13890453 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42
Sep 30 18:11:08 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:08 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:08 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-cda0ba24-43c6-4220-85d0-bb391d46d3dc-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-cda0ba24-43c6-4220-85d0-bb391d46d3dc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:08 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d378996f-8cd0-4583-b368-ddce13890453 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42" returned: 0 in 0.317s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:08 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 is being set with open permissions: ugo+rw
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:08 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42
Sep 30 18:11:08 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:08 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "cinder-quobyte-cda0ba24-43c6-4220-85d0-bb391d46d3dc" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.287s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Deleted volume successfully.
Sep 30 18:11:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-cda0ba24-43c6-4220-85d0-bb391d46d3dc" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-eaa83d0b-ab1f-45e5-9f0b-5bfb371466b0 tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-09572f36-ec1a-4ad2-b6aa-06e0fab9b1d0-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[37104bf3-3fca-45ac-bce4-e7852c581238]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:09 devstack sudo[107944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc
Sep 30 18:11:09 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:09 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42" returned: 0 in 0.264s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:09 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info
Sep 30 18:11:09 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:09 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc" returned: 0 in 0.377s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:09 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc
Sep 30 18:11:09 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:09 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info" returned: 0 in 0.271s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:09 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info is being set with open permissions: ugo+rw
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:09 devstack sudo[107955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info
Sep 30 18:11:09 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:09 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-cda0ba24-43c6-4220-85d0-bb391d46d3dc" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-quobyte-cda0ba24-43c6-4220-85d0-bb391d46d3dc" released by "delete_volume" :: held 0.710s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:09 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.info" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.737s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Creating offline snapshot a1996ed6-4f59-489d-8377-941769eaa45f of volume ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Created reservations ['b4f7253f-c4cb-44c4-9cef-5165c8cfaec4', '479f753d-82bb-497f-a78b-6339b5a8421d', 'f4960d26-1471-433d-86db-d005a652e595', '5de7b581-a142-490d-9730-86327c420121'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c153c6-eec2-49ce-b2f9-b62a81a74d59]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:09 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1fd534e5-5840-486b-a7e1-5bf112effd21 tempest-ProjectReaderTests-1444058996 None] Create snapshot completed successfully
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:09 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:09 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:09 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7
Sep 30 18:11:09 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:10 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Deleted volume successfully.
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1fe8fa38-1777-42e9-ac2c-776382ca359f tempest-CinderUnicodeTest-1625744984 None] Lock "cinder-cda0ba24-43c6-4220-85d0-bb391d46d3dc-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:10 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" returned: 0 in 0.408s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:10 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f 1G
Sep 30 18:11:10 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:10 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f 1G" returned: 0 in 0.420s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:10 devstack sudo[107973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f
Sep 30 18:11:10 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:10 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f" returned: 0 in 0.339s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:10 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f is being set with open permissions: ugo+rw
Sep 30 18:11:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:11 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f
Sep 30 18:11:11 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-65ccad12-d197-43f3-aa1b-4517746d1a42-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-65ccad12-d197-43f3-aa1b-4517746d1a42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-d378996f-8cd0-4583-b368-ddce13890453" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-d378996f-8cd0-4583-b368-ddce13890453" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-65ccad12-d197-43f3-aa1b-4517746d1a42" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-65ccad12-d197-43f3-aa1b-4517746d1a42" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Deleting offline snapshot 65ccad12-d197-43f3-aa1b-4517746d1a42 of volume d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] snapshot_file for this snap is: volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b97f2-b228-4c3c-9a0c-296f5a097d28]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:11 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f" returned: 0 in 0.307s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:11 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info
Sep 30 18:11:11 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:11 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42
Sep 30 18:11:11 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:11 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info" returned: 0 in 0.274s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:11 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info is being set with open permissions: ugo+rw
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:11 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42" returned: 0 in 0.413s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d378996f-8cd0-4583-b368-ddce13890453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:11 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info
Sep 30 18:11:11 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bd2af3-7cf9-4862-9d74-37bd97c4a4e6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:11 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453
Sep 30 18:11:11 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:11 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.info" returned: 0 in 0.258s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:11 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ba20b306-69c8-436a-b949-f2ec7468bf06 tempest-SnapshotDependencyTests-1205611697 None] Create snapshot completed successfully
Sep 30 18:11:12 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:12 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42
Sep 30 18:11:12 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:12 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42" returned: 0 in 0.376s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:12 devstack sudo[108005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42
Sep 30 18:11:12 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:12 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453.65ccad12-d197-43f3-aa1b-4517746d1a42" returned: 0 in 0.310s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-65ccad12-d197-43f3-aa1b-4517746d1a42" released by "_delete_snapshot" :: held 1.613s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-d378996f-8cd0-4583-b368-ddce13890453" released by "delete_snapshot" :: held 1.640s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Created reservations ['0a7d75f1-9ffd-4cee-a1de-788ce4a136ca', 'a4badf7a-4149-4b4c-9894-eb00ba740bb6', '91990405-6130-40fc-9286-c84f3c65e445', '7bbf21f1-56fd-4329-bf70-3eae52e0c12d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Flow 'volume_create_manager' (ee9ea513-804c-49fc-9686-a5870d8cdfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b186a1fc-f7c8-4826-9dc2-4d64fbaa65ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b186a1fc-f7c8-4826-9dc2-4d64fbaa65ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa86bd51-f91f-47ab-8dee-be666a91c2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97446782ecc949d18fd0d15168a1c207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1996ed6-4f59-489d-8377-941769eaa45f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:13Z,use_quota=True,user_id='6a3abb1d2e0748b6a50aa955d5401476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0378ff-8dbc-4e53-8ba4-da72b4492ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0378ff-8dbc-4e53-8ba4-da72b4492ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a38e6a-3327-4654-a3bf-7cac851757f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a38e6a-3327-4654-a3bf-7cac851757f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa86bd51-f91f-47ab-8dee-be666a91c2ac', 'volume_name': 'volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac', 'volume_size': 1, 'snapshot_id': 'a1996ed6-4f59-489d-8377-941769eaa45f'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21689c3-f31d-4560-8cee-7cbc6ea423ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21689c3-f31d-4560-8cee-7cbc6ea423ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1250f78a-7f12-411c-a2bd-1b989dfe3091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:12 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Volume fa86bd51-f91f-47ab-8dee-be666a91c2ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac', 'volume_size': 1, 'snapshot_id': 'a1996ed6-4f59-489d-8377-941769eaa45f'}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:12 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-quobyte-a1996ed6-4f59-489d-8377-941769eaa45f-fa86bd51-f91f-47ab-8dee-be666a91c2ac" by "_create_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-a1996ed6-4f59-489d-8377-941769eaa45f-fa86bd51-f91f-47ab-8dee-be666a91c2ac" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Creating volume fa86bd51-f91f-47ab-8dee-be666a91c2ac from snapshot a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-quobyte-fa86bd51-f91f-47ab-8dee-be666a91c2ac" by "_copy_volume_from_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-fa86bd51-f91f-47ab-8dee-be666a91c2ac" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] snapshot: a1996ed6-4f59-489d-8377-941769eaa45f, volume: fa86bd51-f91f-47ab-8dee-be666a91c2ac,  {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Delete snapshot completed successfully.
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1495e30c-fb2a-4761-ba2b-5d1cb9125762 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-65ccad12-d197-43f3-aa1b-4517746d1a42-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[993db486-cdfc-4274-9969-7daeb2e77f67]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:13 devstack sudo[108008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f
Sep 30 18:11:13 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-d378996f-8cd0-4583-b368-ddce13890453-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Lock "cinder-d378996f-8cd0-4583-b368-ddce13890453-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-d378996f-8cd0-4583-b368-ddce13890453" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-d378996f-8cd0-4583-b368-ddce13890453" acquired by "delete_volume" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c39040d-390d-4f77-a56d-45d311e7b6af]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:13 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f" returned: 0 in 0.420s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:13 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453
Sep 30 18:11:13 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[89886f45-0574-404c-ae55-ef62b8358f3a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:13 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7
Sep 30 18:11:13 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (90ee8a30-e6e3-4752-aea3-224a7057f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa319d7-6d63-42c5-8548-a482b657614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa319d7-6d63-42c5-8548-a482b657614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097926304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2c2853-4220-4d63-9926-8fd091dab183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:14Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8416c1-cbaf-4d55-ae99-e9b2dd6cbe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8416c1-cbaf-4d55-ae99-e9b2dd6cbe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425bf747-5338-4528-b9fe-27a7b60a78c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425bf747-5338-4528-b9fe-27a7b60a78c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2c2853-4220-4d63-9926-8fd091dab183', 'volume_name': 'volume-ba2c2853-4220-4d63-9926-8fd091dab183', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb3c4a2-8c3c-4b7a-868e-35f47968ad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb3c4a2-8c3c-4b7a-868e-35f47968ad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24fea85-8d90-43c0-9866-51aab2acb2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:13 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:13 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Volume ba2c2853-4220-4d63-9926-8fd091dab183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2c2853-4220-4d63-9926-8fd091dab183', 'volume_size': 1}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453" returned: 0 in 0.435s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:13 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453
Sep 30 18:11:13 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:13 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" returned: 0 in 0.422s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Creating direct copy from snapshot {{(pid=87418) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG cinder.utils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Path /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac not found in is_blk_device check {{(pid=87418) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 30 18:11:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:14 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac
Sep 30 18:11:14 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:14 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-d378996f-8cd0-4583-b368-ddce13890453" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-d378996f-8cd0-4583-b368-ddce13890453" released by "delete_volume" :: held 0.756s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Created reservations ['c9109057-cb40-422a-ad7b-3229db04fdd2', '7abd925f-4dd9-4ecf-b970-6468c15e607c', '5baf2a18-c130-4d5c-b725-a6219c35f9f7', 'b3f1f238-dce0-42a6-800c-406acd17b06e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:14 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:14 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:14 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.336s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:14 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Deleted volume successfully.
Sep 30 18:11:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c103698f-8006-460c-944b-f30af270d7ed tempest-ProjectReaderTests-1444058996 None] Lock "cinder-d378996f-8cd0-4583-b368-ddce13890453-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (c6c09687-b64b-4f10-9a4f-4dff49e186bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d192094-7d43-492a-9354-11204538b3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d192094-7d43-492a-9354-11204538b3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1684267014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396913b-0ed9-4c51-abb8-25d212bbe7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:15Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c745a3c5-02c1-43b5-934b-6cebb963a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c745a3c5-02c1-43b5-934b-6cebb963a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eff086-76b2-4a84-ba15-4d7145749593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eff086-76b2-4a84-ba15-4d7145749593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8396913b-0ed9-4c51-abb8-25d212bbe7ac', 'volume_name': 'volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108ba360-fa51-4152-8cbd-e35a465fcee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108ba360-fa51-4152-8cbd-e35a465fcee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62db15fc-8fa6-44b7-864a-91c53fa9c950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:15 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Volume 8396913b-0ed9-4c51-abb8-25d212bbe7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac', 'volume_size': 1}
Sep 30 18:11:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:20 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac" returned: 0 in 6.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.image.image_utils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Image conversion details: src /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac {{(pid=87418) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 30 18:11:20 devstack cinder-volume[87418]: INFO cinder.image.image_utils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Converted 1024.00 MB image at 163.54 MB/s
Sep 30 18:11:20 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac is being set with open permissions: ugo+rw
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:20 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac
Sep 30 18:11:20 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:20 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac" returned: 0 in 0.235s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-fa86bd51-f91f-47ab-8dee-be666a91c2ac" released by "_copy_volume_from_snapshot" :: held 7.451s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-a1996ed6-4f59-489d-8377-941769eaa45f-fa86bd51-f91f-47ab-8dee-be666a91c2ac" released by "_create_volume_from_snapshot" :: held 7.515s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.536s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097926304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2c2853-4220-4d63-9926-8fd091dab183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:14Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Creating volume ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:20 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:20 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 1073741824
Sep 30 18:11:20 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1250f78a-7f12-411c-a2bd-1b989dfe3091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac', 'volume_size': 1, 'snapshot_id': 'a1996ed6-4f59-489d-8377-941769eaa45f'}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f098d0-8ca1-441d-9413-416e74f9893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:20 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Volume volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac (fa86bd51-f91f-47ab-8dee-be666a91c2ac): created successfully
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f098d0-8ca1-441d-9413-416e74f9893a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Flow 'volume_create_manager' (ee9ea513-804c-49fc-9686-a5870d8cdfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-07498158-3d48-44ea-ac08-dc010d864605 tempest-SnapshotDependencyTests-1205611697 None] Created volume successfully.
Sep 30 18:11:20 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 1073741824" returned: 0 in 0.404s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:21 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183
Sep 30 18:11:21 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:21 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.975s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1684267014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396913b-0ed9-4c51-abb8-25d212bbe7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:15Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Creating volume 8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:21 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24fea85-8d90-43c0-9866-51aab2acb2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2c2853-4220-4d63-9926-8fd091dab183', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:21 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac 1073741824
Sep 30 18:11:21 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4885a90e-6d69-4859-a48e-1a62b97ba974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:21 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Volume volume-ba2c2853-4220-4d63-9926-8fd091dab183 (ba2c2853-4220-4d63-9926-8fd091dab183): created successfully
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4885a90e-6d69-4859-a48e-1a62b97ba974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (90ee8a30-e6e3-4752-aea3-224a7057f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:21 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-43f50557-7dfe-4961-8dab-70523fee7e20 tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-a1996ed6-4f59-489d-8377-941769eaa45f-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-a1996ed6-4f59-489d-8377-941769eaa45f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-quobyte-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-quobyte-a1996ed6-4f59-489d-8377-941769eaa45f" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-a1996ed6-4f59-489d-8377-941769eaa45f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Deleting offline snapshot a1996ed6-4f59-489d-8377-941769eaa45f of volume ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] snapshot_file for this snap is: volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a21246-3dcb-4000-84cd-8c9b5ae5439b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:21 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f
Sep 30 18:11:21 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:21 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac 1073741824" returned: 0 in 0.451s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:21 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac
Sep 30 18:11:21 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:21 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f" returned: 0 in 0.358s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a712281-3c21-4bae-bcb8-7a0cc48b3f30]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:21 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:21 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62db15fc-8fa6-44b7-864a-91c53fa9c950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0136944b-803a-4501-9406-d13951599cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:22 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Volume volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac (8396913b-0ed9-4c51-abb8-25d212bbe7ac): created successfully
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0136944b-803a-4501-9406-d13951599cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (c6c09687-b64b-4f10-9a4f-4dff49e186bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:22 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-0b497c1f-d636-47c2-80e4-affda602745b tempest-ProjectReaderTests-1444058996 None] Created volume successfully.
Sep 30 18:11:22 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7
Sep 30 18:11:22 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:22 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" returned: 0 in 0.564s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:22 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f
Sep 30 18:11:22 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot 057ef6eb-10a4-4865-ae68-a7e1f190662b of volume ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03ceca0-e060-4c45-b4ca-17039b4a1325]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:22 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183
Sep 30 18:11:22 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:22 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:22 devstack sudo[108085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f
Sep 30 18:11:22 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:23 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183" returned: 0 in 0.400s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:23 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b 1G
Sep 30 18:11:23 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:23 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7.a1996ed6-4f59-489d-8377-941769eaa45f" returned: 0 in 0.259s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-a1996ed6-4f59-489d-8377-941769eaa45f" released by "_delete_snapshot" :: held 1.672s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" released by "delete_snapshot" :: held 1.694s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Created reservations ['4cb62667-f895-4f2c-8a39-e8e0f8249852', 'e0afd450-fc5b-46ed-ba91-a42b15eaf6e9', '4095a6b7-ee25-443e-9de8-1ef2878c5d08', '154fdecf-809d-4a33-a2fa-255657252b7d'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:23 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Delete snapshot completed successfully.
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-ea13a25c-6112-4576-9bc9-60ea1ac0219e tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-a1996ed6-4f59-489d-8377-941769eaa45f-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:23 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b 1G" returned: 0 in 0.396s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2c2853-4220-4d63-9926-8fd091dab183 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:23 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2c2853-4220-4d63-9926-8fd091dab183 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b
Sep 30 18:11:23 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-quobyte-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6b39e5-4128-4e25-9ee4-f8c2d0a27b10]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:23 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2c2853-4220-4d63-9926-8fd091dab183 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b" returned: 0 in 0.320s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:23 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b is being set with open permissions: ugo+rw
Sep 30 18:11:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:23 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b
Sep 30 18:11:23 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:23 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7
Sep 30 18:11:23 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:24 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:24 devstack sudo[108109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info
Sep 30 18:11:24 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:24 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" returned: 0 in 0.373s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:24 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7
Sep 30 18:11:24 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:24 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:24 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info is being set with open permissions: ugo+rw
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:24 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info
Sep 30 18:11:24 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:24 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" returned: 0 in 0.252s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7" released by "delete_volume" :: held 0.693s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Created reservations ['cc7ca4df-de1e-4797-b5c7-cc826189c902', '8522a7fd-b62f-40a4-a159-861a156a87d1', '20528069-7619-4ba3-8817-1347ab411304', 'ccb49572-b556-4737-a427-a6d1c7dbd212'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:24 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:24 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:24 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.info" returned: 0 in 0.253s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.865s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Creating offline snapshot d0761639-fc15-443e-abc8-04b08795d0e6 of volume 8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-24deb054-36be-4df9-af3e-f591c5a94c1d tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb1ba8-aaf8-4073-9907-b80ac64154fb]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-057ef6eb-10a4-4865-ae68-a7e1f190662b-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:24 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.280s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Deleted volume successfully.
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-057ef6eb-10a4-4865-ae68-a7e1f190662b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:24 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-ba2c2853-4220-4d63-9926-8fd091dab183" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:24 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-fa86bd51-f91f-47ab-8dee-be666a91c2ac-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ba2c2853-4220-4d63-9926-8fd091dab183" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-057ef6eb-10a4-4865-ae68-a7e1f190662b" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dc349295-313a-43a3-9aa6-f807e9addeae tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-ff9b26e4-7c86-460a-b7c2-9d493c9e87e7-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-fa86bd51-f91f-47ab-8dee-be666a91c2ac-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-057ef6eb-10a4-4865-ae68-a7e1f190662b" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot 057ef6eb-10a4-4865-ae68-a7e1f190662b of volume ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ca20a8-4d89-4181-82a2-27156eb0a73e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "cinder-quobyte-fa86bd51-f91f-47ab-8dee-be666a91c2ac" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-fa86bd51-f91f-47ab-8dee-be666a91c2ac" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d52381-cba5-4fc9-97c1-9a6405f8ebd0]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b
Sep 30 18:11:25 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac
Sep 30 18:11:25 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 1G
Sep 30 18:11:25 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b" returned: 0 in 0.381s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2c2853-4220-4d63-9926-8fd091dab183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5573a03c-8661-48c3-8ea3-ff200f90b9ba]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac" returned: 0 in 0.383s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac
Sep 30 18:11:25 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack sudo[108141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183
Sep 30 18:11:25 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 1G" returned: 0 in 0.442s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6
Sep 30 18:11:25 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-fa86bd51-f91f-47ab-8dee-be666a91c2ac" returned: 0 in 0.275s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-quobyte-fa86bd51-f91f-47ab-8dee-be666a91c2ac" released by "delete_volume" :: held 0.708s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Created reservations ['1d02caea-b566-4a2a-acf9-db060ddd2b04', 'e2c35694-bacd-41b2-b5bf-bcdba2b28fca', '3c1154bd-a085-40c8-b3ba-1547b1b5cf80', 'f13dca97-4862-494b-bd3c-ffc37af6180f'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:25 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183" returned: 0 in 0.391s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b
Sep 30 18:11:25 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:25 devstack sudo[108158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:25 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6" returned: 0 in 0.343s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:25 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 is being set with open permissions: ugo+rw
Sep 30 18:11:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:25 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6
Sep 30 18:11:25 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:26 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Deleted volume successfully.
Sep 30 18:11:26 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b" returned: 0 in 0.407s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:26 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b
Sep 30 18:11:26 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:26 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c6c0639f-f793-4f4a-9b44-f11f1f38a168 tempest-SnapshotDependencyTests-1205611697 None] Lock "cinder-fa86bd51-f91f-47ab-8dee-be666a91c2ac-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6" returned: 0 in 0.298s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:26 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info
Sep 30 18:11:26 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:26 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183.057ef6eb-10a4-4865-ae68-a7e1f190662b" returned: 0 in 0.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-057ef6eb-10a4-4865-ae68-a7e1f190662b" released by "_delete_snapshot" :: held 1.579s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ba2c2853-4220-4d63-9926-8fd091dab183" released by "delete_snapshot" :: held 1.636s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:26 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info" returned: 0 in 0.256s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:26 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info is being set with open permissions: ugo+rw
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:26 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info
Sep 30 18:11:26 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Created reservations ['841a5123-e9bc-457b-8f91-a4ba038a667f', '48f8045a-7758-441d-ab2c-bfe5ac48765e', '7b1da123-5571-4c56-825c-728c8a1f8bff', '848d7e08-8a75-4bab-9308-b00660c51806'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-a10ea11d-1a7f-4ec0-9ca5-ba6e6f2c7491 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-057ef6eb-10a4-4865-ae68-a7e1f190662b-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:26 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.info" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:26 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d602a063-815c-4a88-af57-3ec95adad2bb tempest-ProjectReaderTests-1444058996 None] Create snapshot completed successfully
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-ba2c2853-4220-4d63-9926-8fd091dab183-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Lock "cinder-ba2c2853-4220-4d63-9926-8fd091dab183-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-d0761639-fc15-443e-abc8-04b08795d0e6-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-ba2c2853-4220-4d63-9926-8fd091dab183" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-d0761639-fc15-443e-abc8-04b08795d0e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-8396913b-0ed9-4c51-abb8-25d212bbe7ac" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-8396913b-0ed9-4c51-abb8-25d212bbe7ac" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-d0761639-fc15-443e-abc8-04b08795d0e6" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ba2c2853-4220-4d63-9926-8fd091dab183" acquired by "delete_volume" :: waited 0.030s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a8b79f-4d5c-402c-898a-f1f7085cd6e7]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-d0761639-fc15-443e-abc8-04b08795d0e6" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Deleting offline snapshot d0761639-fc15-443e-abc8-04b08795d0e6 of volume 8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] snapshot_file for this snap is: volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[201033f0-4e7e-4c55-84c8-22f7ca3d8d15]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:27 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183
Sep 30 18:11:27 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:27 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6
Sep 30 18:11:27 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:27 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183" returned: 0 in 0.406s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:27 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:27 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6" returned: 0 in 0.389s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:27 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bfb2c1-d1ed-4674-9755-99551c8cf17d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:27 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac
Sep 30 18:11:27 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:27 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ba2c2853-4220-4d63-9926-8fd091dab183" returned: 0 in 0.292s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ba2c2853-4220-4d63-9926-8fd091dab183" released by "delete_volume" :: held 0.771s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:27 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Created reservations ['6d5e6876-1d6e-4786-8047-ae69391946b4', 'f74562f0-a664-43b5-820b-c00d43e12d29', '6c463d40-9957-4348-8e7e-9769a9261fc9', '29dca9bd-851a-4556-aa73-80e6617d5c26'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:28 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:28 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:28 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac" returned: 0 in 0.401s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:28 devstack sudo[108200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6
Sep 30 18:11:28 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:28 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.309s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:28 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9da7b449-080a-4ba8-9b59-472f0ea241fc tempest-ProjectMemberTests-2136822435 None] Lock "cinder-ba2c2853-4220-4d63-9926-8fd091dab183-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:28 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6" returned: 0 in 0.437s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:28 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6
Sep 30 18:11:28 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (5c041656-9ee4-4ce3-8701-b91bc3aa4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288b3271-fa09-41a1-873f-3c30274c1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288b3271-fa09-41a1-873f-3c30274c1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823161495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7a59bb-4992-4ac7-884d-fa62078933b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:29Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0944dc8-6a00-4a4c-82e9-4a180bf03b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0944dc8-6a00-4a4c-82e9-4a180bf03b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90ecec5-78b2-44db-aa65-4519f09e9f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90ecec5-78b2-44db-aa65-4519f09e9f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7a59bb-4992-4ac7-884d-fa62078933b3', 'volume_name': 'volume-ad7a59bb-4992-4ac7-884d-fa62078933b3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f12eea-3d2c-45f2-bb0b-628f82eb954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f12eea-3d2c-45f2-bb0b-628f82eb954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfc1ccd-5550-4b94-a287-66c0f52695a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:28 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Volume ad7a59bb-4992-4ac7-884d-fa62078933b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7a59bb-4992-4ac7-884d-fa62078933b3', 'volume_size': 1}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823161495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7a59bb-4992-4ac7-884d-fa62078933b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:29Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Creating volume ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:28 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:28 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac.d0761639-fc15-443e-abc8-04b08795d0e6" returned: 0 in 0.304s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:28 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 1073741824
Sep 30 18:11:28 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-d0761639-fc15-443e-abc8-04b08795d0e6" released by "_delete_snapshot" :: held 1.674s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-8396913b-0ed9-4c51-abb8-25d212bbe7ac" released by "delete_snapshot" :: held 1.740s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:28 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Created reservations ['378037f3-79cb-4c07-ac09-55f8b02096d4', '879dded5-5a89-40df-bb3d-3ac71a7d73f1', '1b707de0-a54b-4087-aea1-9ae9121ac72a', 'bf18eb6d-6f4a-439e-811f-ceba02986e3b'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Delete snapshot completed successfully.
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f0de9905-3758-4eaf-8b63-d0beef8df4c5 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-d0761639-fc15-443e-abc8-04b08795d0e6-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:29 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 1073741824" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-8396913b-0ed9-4c51-abb8-25d212bbe7ac-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-8396913b-0ed9-4c51-abb8-25d212bbe7ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:29 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3
Sep 30 18:11:29 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-8396913b-0ed9-4c51-abb8-25d212bbe7ac" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-8396913b-0ed9-4c51-abb8-25d212bbe7ac" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0126d8be-bafd-455a-b835-545050a0b824]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:29 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac
Sep 30 18:11:29 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:29 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3" returned: 0 in 0.303s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfc1ccd-5550-4b94-a287-66c0f52695a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7a59bb-4992-4ac7-884d-fa62078933b3', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b1461d-2cc9-4e68-a618-439398154409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:29 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Volume volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 (ad7a59bb-4992-4ac7-884d-fa62078933b3): created successfully
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b1461d-2cc9-4e68-a618-439398154409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (5c041656-9ee4-4ce3-8701-b91bc3aa4bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-43d9fab2-4af9-472f-ab73-a288c3799930 tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:11:29 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac" returned: 0 in 0.462s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:29 devstack sudo[108222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac
Sep 30 18:11:29 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:30 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8396913b-0ed9-4c51-abb8-25d212bbe7ac" returned: 0 in 0.251s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-8396913b-0ed9-4c51-abb8-25d212bbe7ac" released by "delete_volume" :: held 0.783s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Created reservations ['253865b8-80d4-4ef6-8cc1-d4de0fe11160', '62784fb5-d078-4e5a-951c-e1696cb7e6ee', 'e8ffcef9-d580-488d-b413-39834eacb4f3', 'e0bd8bbf-0781-4b60-9262-5cf7e8e890f1'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:30 devstack sudo[108225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:30 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:30 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:30 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Deleted volume successfully.
Sep 30 18:11:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-49d8bc40-1cec-418f-bbb3-a2e17669f862 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-8396913b-0ed9-4c51-abb8-25d212bbe7ac-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (1662209e-fabe-4244-92fc-59853d336cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9058bc-89b1-44d3-93bd-0ebb17874dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot 30a28fcd-b9fd-49d0-a96f-82ae49ed98cc of volume ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9058bc-89b1-44d3-93bd-0ebb17874dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423240694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbf4d47-7bc8-4848-bdcd-4ae2189c9913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:31Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2081b2f3-1fa7-4b60-a0f5-039e76434b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2081b2f3-1fa7-4b60-a0f5-039e76434b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e2dd3-8820-4ed4-b1ff-910ef0296f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e2dd3-8820-4ed4-b1ff-910ef0296f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbf4d47-7bc8-4848-bdcd-4ae2189c9913', 'volume_name': 'volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79a2390-c67a-4ed0-b0e7-3d8385303568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79a2390-c67a-4ed0-b0e7-3d8385303568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b13459-6d49-47e6-8f90-c27349e8735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:31 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Volume 9dbf4d47-7bc8-4848-bdcd-4ae2189c9913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913', 'volume_size': 1}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7c914-a6fd-4e01-b848-0bd1e0409563]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:31 devstack sudo[108230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3
Sep 30 18:11:31 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:31 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3" returned: 0 in 0.391s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:31 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc 1G
Sep 30 18:11:31 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:32 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc 1G" returned: 0 in 0.427s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:32 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc
Sep 30 18:11:32 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:32 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" returned: 0 in 0.330s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:32 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc is being set with open permissions: ugo+rw
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:32 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc
Sep 30 18:11:32 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:32 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:32 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info
Sep 30 18:11:32 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:32 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info" returned: 0 in 0.252s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:32 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info is being set with open permissions: ugo+rw
Sep 30 18:11:32 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:32 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info
Sep 30 18:11:32 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:33 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.info" returned: 0 in 0.287s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.999s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423240694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbf4d47-7bc8-4848-bdcd-4ae2189c9913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:31Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Creating volume 9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:33 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:33 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 1073741824
Sep 30 18:11:33 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-3bd8a66f-2b53-42e1-acb9-4e515bd89ce2 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:11:33 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 1073741824" returned: 0 in 0.419s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:33 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913
Sep 30 18:11:33 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:33 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b13459-6d49-47e6-8f90-c27349e8735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648cefd0-5416-46cc-a73f-b5361f2bd994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:33 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Volume volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 (9dbf4d47-7bc8-4848-bdcd-4ae2189c9913): created successfully
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648cefd0-5416-46cc-a73f-b5361f2bd994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:33 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (1662209e-fabe-4244-92fc-59853d336cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:33 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b21c559b-ae56-4d4d-add9-a52be30a8154 tempest-ProjectReaderTests-1444058996 None] Created volume successfully.
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-30a28fcd-b9fd-49d0-a96f-82ae49ed98cc-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-30a28fcd-b9fd-49d0-a96f-82ae49ed98cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-ad7a59bb-4992-4ac7-884d-fa62078933b3" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ad7a59bb-4992-4ac7-884d-fa62078933b3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot 30a28fcd-b9fd-49d0-a96f-82ae49ed98cc of volume ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[21847872-8bce-4506-8e6f-1428458f685b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:34 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:34 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Creating offline snapshot cee355c0-bc82-4f6b-8d85-56959944c68b of volume 9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b629e1a1-fddc-47bc-9ed8-ab291a476961]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:34 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913
Sep 30 18:11:34 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:34 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad7a59bb-4992-4ac7-884d-fa62078933b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b90a72-5929-42ed-ac04-753a61d45ee9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:34 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3
Sep 30 18:11:34 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:34 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" returned: 0 in 0.437s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:34 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:34 devstack sudo[108279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b 1G
Sep 30 18:11:34 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:35 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:35 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc
Sep 30 18:11:35 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:35 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b 1G" returned: 0 in 0.529s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:35 devstack sudo[108292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b
Sep 30 18:11:35 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:35 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:35 devstack sudo[108295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc
Sep 30 18:11:35 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:35 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b" returned: 0 in 0.332s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:35 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b is being set with open permissions: ugo+rw
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:35 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b
Sep 30 18:11:35 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:35 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:35 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3.30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" returned: 0 in 0.283s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-30a28fcd-b9fd-49d0-a96f-82ae49ed98cc" released by "_delete_snapshot" :: held 1.732s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ad7a59bb-4992-4ac7-884d-fa62078933b3" released by "delete_snapshot" :: held 1.769s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Created reservations ['3be27958-419a-4e19-bfee-352bdc0ac1f3', 'd3ae7254-452f-427b-ab48-7fba43b95dc8', '7d62d199-15a5-4798-b375-b783ff375187', 'bbb3d676-4874-4072-b1b0-2ca3bfc9da42'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:36 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b" returned: 0 in 0.290s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:36 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info
Sep 30 18:11:36 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-2a199351-6ea8-4c45-b354-376dc410af98 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-30a28fcd-b9fd-49d0-a96f-82ae49ed98cc-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-ad7a59bb-4992-4ac7-884d-fa62078933b3-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:36 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info" returned: 0 in 0.300s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:36 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info is being set with open permissions: ugo+rw
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-ad7a59bb-4992-4ac7-884d-fa62078933b3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:36 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info
Sep 30 18:11:36 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-ad7a59bb-4992-4ac7-884d-fa62078933b3" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ad7a59bb-4992-4ac7-884d-fa62078933b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c15218e-da38-47cb-af10-f85acc736b76]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:36 devstack sudo[108311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3
Sep 30 18:11:36 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:36 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.info" returned: 0 in 0.282s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:36 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:36 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b3cb610f-0836-434a-b1af-29722b0eb1cb tempest-ProjectReaderTests-1444058996 None] Create snapshot completed successfully
Sep 30 18:11:36 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3" returned: 0 in 0.405s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:37 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3
Sep 30 18:11:37 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:37 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-ad7a59bb-4992-4ac7-884d-fa62078933b3" returned: 0 in 0.242s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-ad7a59bb-4992-4ac7-884d-fa62078933b3" released by "delete_volume" :: held 0.722s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Created reservations ['08b3f7ad-a1e3-4018-be9c-b0e8be89f61a', 'e13bec47-bd05-4079-8d9c-295b66868ded', 'c107e36c-02e3-4582-85e0-a11574e32d25', 'fa2aa2c6-7b1e-42e3-af9a-86bf0162e409'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:37 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:37 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:37 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:37 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-6fa2d1ed-fa24-4d14-850b-c6cba5bb0c84 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-ad7a59bb-4992-4ac7-884d-fa62078933b3-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-cee355c0-bc82-4f6b-8d85-56959944c68b-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Lock "cinder-cee355c0-bc82-4f6b-8d85-56959944c68b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-cee355c0-bc82-4f6b-8d85-56959944c68b" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-cee355c0-bc82-4f6b-8d85-56959944c68b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Deleting offline snapshot cee355c0-bc82-4f6b-8d85-56959944c68b of volume 9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] snapshot_file for this snap is: volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[86608bb0-7ea7-4107-851b-6da124e8cc52]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:37 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:37 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b
Sep 30 18:11:37 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (5040073f-9abe-4cb3-b461-55bf46f2d636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e18d98-1435-4c6d-ad10-a6cf22e09941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e18d98-1435-4c6d-ad10-a6cf22e09941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743727940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e892ec-22a9-444e-b000-4fd674091ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:38Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6beac5c-fa3a-4931-a15a-67b36fe9fbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6beac5c-fa3a-4931-a15a-67b36fe9fbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3728f0-a1f5-43f3-afee-e7cbaef637a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3728f0-a1f5-43f3-afee-e7cbaef637a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e892ec-22a9-444e-b000-4fd674091ff2', 'volume_name': 'volume-c0e892ec-22a9-444e-b000-4fd674091ff2', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1c5c39-5bf6-416a-bfbb-b3e4c61ac758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1c5c39-5bf6-416a-bfbb-b3e4c61ac758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292dbdeb-7395-40a5-a724-6444a5604bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:38 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Volume c0e892ec-22a9-444e-b000-4fd674091ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e892ec-22a9-444e-b000-4fd674091ff2', 'volume_size': 1}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743727940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e892ec-22a9-444e-b000-4fd674091ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:38Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Creating volume c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:38 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:38 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b" returned: 0 in 0.387s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:38 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 1073741824
Sep 30 18:11:38 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[174aa1a7-3647-418f-8be6-b49a40af5588]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:38 devstack sudo[108331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913
Sep 30 18:11:38 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:38 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 1073741824" returned: 0 in 0.421s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:38 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" returned: 0 in 0.382s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:38 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b
Sep 30 18:11:38 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:38 devstack sudo[108341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2
Sep 30 18:11:38 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:38 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292dbdeb-7395-40a5-a724-6444a5604bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e892ec-22a9-444e-b000-4fd674091ff2', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b81190-3759-4661-b658-cd8eb266ac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:38 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Volume volume-c0e892ec-22a9-444e-b000-4fd674091ff2 (c0e892ec-22a9-444e-b000-4fd674091ff2): created successfully
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b81190-3759-4661-b658-cd8eb266ac7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:38 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (5040073f-9abe-4cb3-b461-55bf46f2d636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b" returned: 0 in 0.339s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:38 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:38 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-98f15b7e-591c-4f95-8ecb-ee2d17e5a1cb tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:11:38 devstack sudo[108347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b
Sep 30 18:11:38 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:39 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913.cee355c0-bc82-4f6b-8d85-56959944c68b" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-cee355c0-bc82-4f6b-8d85-56959944c68b" released by "_delete_snapshot" :: held 1.491s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" released by "delete_snapshot" :: held 1.524s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot 103cd7e1-6e04-4284-9b75-3824a2361a78 of volume c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb9e17-f086-4480-8833-3afb1c7740dd]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Created reservations ['88fca536-f8d9-47e8-a256-5760fe055f50', 'c9383a7b-22ee-40af-886f-53af47d01fac', 'c437d9c9-b180-431d-ac1d-abe4c90e7d12', '5d347a69-dad7-451b-8e41-0d8cb58fc3a5'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:39 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Delete snapshot completed successfully.
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9664faf5-0a19-49b7-b94f-0f76803a443d tempest-ProjectReaderTests-1444058996 None] Lock "cinder-cee355c0-bc82-4f6b-8d85-56959944c68b-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:39 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2
Sep 30 18:11:39 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:39 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2" returned: 0 in 0.366s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:39 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 1G
Sep 30 18:11:39 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Lock "cinder-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3cb4c5-af24-45c1-a679-bf65f5a87f3b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:39 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:40 devstack sudo[108360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913
Sep 30 18:11:40 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:40 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 1G" returned: 0 in 0.446s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e892ec-22a9-444e-b000-4fd674091ff2 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:40 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e892ec-22a9-444e-b000-4fd674091ff2 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78
Sep 30 18:11:40 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:40 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" returned: 0 in 0.372s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:40 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913
Sep 30 18:11:40 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:40 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e892ec-22a9-444e-b000-4fd674091ff2 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78" returned: 0 in 0.324s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:40 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 is being set with open permissions: ugo+rw
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:40 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78
Sep 30 18:11:40 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:40 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913" released by "delete_volume" :: held 0.692s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Created reservations ['25f84de4-577c-4e56-807a-6a77afed5e0e', '3aff7ff7-bf98-4ecb-99bf-73857474a5a8', '26fb81b0-a68c-4670-9ed9-f728b8485fc2', '5f160e92-ea3f-49ff-b71c-e60bbc49c2c2'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:40 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:40 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info
Sep 30 18:11:40 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:40 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:40 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:40 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:40 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info is being set with open permissions: ugo+rw
Sep 30 18:11:40 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:41 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info
Sep 30 18:11:41 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:41 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Deleted volume successfully.
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c3d07496-7cd2-4f09-a7cd-1e64bf5effca tempest-ProjectReaderTests-1444058996 None] Lock "cinder-9dbf4d47-7bc8-4848-bdcd-4ae2189c9913-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:41 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.info" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:41 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-32e430ce-c538-4ba8-8810-800dbbfd1d23 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (d02e0c58-2e77-44a0-8949-04edc23a20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943c84f8-7685-4d32-af5d-75c0a1bd947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943c84f8-7685-4d32-af5d-75c0a1bd947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98644369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a30651-48bd-4aea-8ba7-38c20edcd60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:41Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a921ae9-1301-4778-a79d-8a39182db791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a921ae9-1301-4778-a79d-8a39182db791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89bbba6-cae4-4efb-adf5-d5e8d195d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89bbba6-cae4-4efb-adf5-d5e8d195d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a30651-48bd-4aea-8ba7-38c20edcd60d', 'volume_name': 'volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cadf0c5a-24ad-47fa-99ec-5b0c98eda41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cadf0c5a-24ad-47fa-99ec-5b0c98eda41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67412444-0e6b-41f5-bd3a-7a17ebb48292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:41 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Volume a9a30651-48bd-4aea-8ba7-38c20edcd60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d', 'volume_size': 1}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98644369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a30651-48bd-4aea-8ba7-38c20edcd60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:41Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Creating volume a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:41 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:41 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d 1073741824
Sep 30 18:11:41 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:41 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d 1073741824" returned: 0 in 0.402s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:41 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:42 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d
Sep 30 18:11:42 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:42 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d" returned: 0 in 0.239s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67412444-0e6b-41f5-bd3a-7a17ebb48292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e19b43c-13d8-4769-8900-bd04e22ceafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:42 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Volume volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d (a9a30651-48bd-4aea-8ba7-38c20edcd60d): created successfully
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e19b43c-13d8-4769-8900-bd04e22ceafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (d02e0c58-2e77-44a0-8949-04edc23a20eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:42 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c2071e8c-0f29-479d-bbe8-7bd27a491583 tempest-ProjectReaderTests-1444058996 None] Created volume successfully.
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-103cd7e1-6e04-4284-9b75-3824a2361a78-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-103cd7e1-6e04-4284-9b75-3824a2361a78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-c0e892ec-22a9-444e-b000-4fd674091ff2" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-c0e892ec-22a9-444e-b000-4fd674091ff2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-103cd7e1-6e04-4284-9b75-3824a2361a78" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-103cd7e1-6e04-4284-9b75-3824a2361a78" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot 103cd7e1-6e04-4284-9b75-3824a2361a78 of volume c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[74146119-fd75-4dca-bee5-60d2d311e0fd]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:42 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78
Sep 30 18:11:42 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Creating offline snapshot a4e21873-434a-4a6f-ac05-54c59926b938 of volume a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d6edd6-1ce9-4f29-89e1-e47964db62be]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:42 devstack sudo[108402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d
Sep 30 18:11:42 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:42 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78" returned: 0 in 0.389s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0e892ec-22a9-444e-b000-4fd674091ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ec354-c2b4-4b70-b499-42ab28b09f33]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:42 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:43 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2
Sep 30 18:11:43 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:43 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d" returned: 0 in 0.368s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:43 devstack sudo[108412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 1G
Sep 30 18:11:43 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:43 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2" returned: 0 in 0.349s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:43 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78
Sep 30 18:11:43 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:43 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 1G" returned: 0 in 0.430s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:43 devstack sudo[108422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938
Sep 30 18:11:43 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:43 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:43 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78
Sep 30 18:11:43 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:43 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938" returned: 0 in 0.308s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:43 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 is being set with open permissions: ugo+rw
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:43 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938
Sep 30 18:11:43 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:43 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2.103cd7e1-6e04-4284-9b75-3824a2361a78" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-103cd7e1-6e04-4284-9b75-3824a2361a78" released by "_delete_snapshot" :: held 1.464s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:43 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-c0e892ec-22a9-444e-b000-4fd674091ff2" released by "delete_snapshot" :: held 1.494s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Created reservations ['51028755-291d-469f-bc5b-c35e30fe8e52', '3e59b0f2-491e-44ba-a414-f056ec00f4e8', '025c2a57-c03d-4a66-94aa-3742b4bb0b4a', 'f1d083f9-081f-411d-9cb1-ad1f06524288'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:44 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938" returned: 0 in 0.252s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-1836c559-a3f1-4411-ad89-eb5732c7baf4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-103cd7e1-6e04-4284-9b75-3824a2361a78-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:44 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info
Sep 30 18:11:44 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:44 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info" returned: 0 in 0.246s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:44 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info is being set with open permissions: ugo+rw
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:44 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info
Sep 30 18:11:44 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:44 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-c0e892ec-22a9-444e-b000-4fd674091ff2-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.info" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-c0e892ec-22a9-444e-b000-4fd674091ff2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:44 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7057b65e-cc9d-44e3-bf3e-148d253f9ae8 tempest-ProjectReaderTests-1444058996 None] Create snapshot completed successfully
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-c0e892ec-22a9-444e-b000-4fd674091ff2" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-c0e892ec-22a9-444e-b000-4fd674091ff2" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ed01d3-c14f-411a-a2a1-ddf13681aebd]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-a4e21873-434a-4a6f-ac05-54c59926b938-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-a4e21873-434a-4a6f-ac05-54c59926b938-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-a9a30651-48bd-4aea-8ba7-38c20edcd60d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-a9a30651-48bd-4aea-8ba7-38c20edcd60d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-a4e21873-434a-4a6f-ac05-54c59926b938" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-a4e21873-434a-4a6f-ac05-54c59926b938" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Deleting offline snapshot a4e21873-434a-4a6f-ac05-54c59926b938 of volume a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] snapshot_file for this snap is: volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:44 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2
Sep 30 18:11:44 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d2cf3-d52d-46c3-824a-df479da0df97]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:44 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:44 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938
Sep 30 18:11:44 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:45 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2" returned: 0 in 0.383s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:45 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2
Sep 30 18:11:45 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:45 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938" returned: 0 in 0.378s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[977da96d-5df2-4b12-848b-151bca3bd135]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:45 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-c0e892ec-22a9-444e-b000-4fd674091ff2" returned: 0 in 0.259s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:45 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d
Sep 30 18:11:45 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-c0e892ec-22a9-444e-b000-4fd674091ff2" released by "delete_volume" :: held 0.727s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Created reservations ['de50a2ce-e115-41d7-be51-f8048e2e085d', '93901eed-3c8e-412d-acbf-382d5e12f393', '3e7bb2b9-6faf-4a8b-9664-17dc2108685f', '97f30673-24d0-4ac8-bb86-8b5235ff6fcd'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:45 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:45 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:45 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d" returned: 0 in 0.376s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:45 devstack sudo[108462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938
Sep 30 18:11:45 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:45 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.261s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:45 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:11:45 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-bee2fa06-1bb4-4ddb-add7-c1c4f739d441 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-c0e892ec-22a9-444e-b000-4fd674091ff2-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:46 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938" returned: 0 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:46 devstack sudo[108468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938
Sep 30 18:11:46 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (5798c1f8-3a94-46e1-b899-4b2979f91114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b93d3a-3d7d-4ac4-bb48-1eca282070cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b93d3a-3d7d-4ac4-bb48-1eca282070cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097263056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35329f4e-93df-4748-a17b-70bb9b10931d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:46Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d907339-0d51-4d6e-9fec-4a0ebe8e1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d907339-0d51-4d6e-9fec-4a0ebe8e1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f84ec74-ff18-4d3b-9638-89d6dc637985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f84ec74-ff18-4d3b-9638-89d6dc637985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35329f4e-93df-4748-a17b-70bb9b10931d', 'volume_name': 'volume-35329f4e-93df-4748-a17b-70bb9b10931d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d2549c-2425-4fe6-8e81-4a985aaf377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d2549c-2425-4fe6-8e81-4a985aaf377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a543af7c-4ae1-4557-9dd3-22efa4ab4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:46 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Volume 35329f4e-93df-4748-a17b-70bb9b10931d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35329f4e-93df-4748-a17b-70bb9b10931d', 'volume_size': 1}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097263056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35329f4e-93df-4748-a17b-70bb9b10931d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:46Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Creating volume 35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:46 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:46 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d.a4e21873-434a-4a6f-ac05-54c59926b938" returned: 0 in 0.265s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:46 devstack sudo[108471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d 1073741824
Sep 30 18:11:46 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-a4e21873-434a-4a6f-ac05-54c59926b938" released by "_delete_snapshot" :: held 1.482s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-a9a30651-48bd-4aea-8ba7-38c20edcd60d" released by "delete_snapshot" :: held 1.504s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Created reservations ['5c2cbc4a-f6e9-4366-975d-981b5d1523bd', '8c1b912a-384b-438f-ad20-c2c87c055be2', '8f70b8da-fc05-4154-b858-1bba4334c02b', 'baf8149d-c3e3-49ab-88af-7a945956f0b3'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:46 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Delete snapshot completed successfully.
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f3368825-467b-4144-8c86-04b236a13568 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-a4e21873-434a-4a6f-ac05-54c59926b938-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:46 devstack sudo[108473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:46 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:46 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d 1073741824" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:46 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.272s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:46 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d
Sep 30 18:11:46 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-a9a30651-48bd-4aea-8ba7-38c20edcd60d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:46 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:46 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Lock "cinder-a9a30651-48bd-4aea-8ba7-38c20edcd60d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a543af7c-4ae1-4557-9dd3-22efa4ab4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35329f4e-93df-4748-a17b-70bb9b10931d', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a88f5-2a74-4b10-80cb-26dafa7cd88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:47 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Volume volume-35329f4e-93df-4748-a17b-70bb9b10931d (35329f4e-93df-4748-a17b-70bb9b10931d): created successfully
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a88f5-2a74-4b10-80cb-26dafa7cd88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (5798c1f8-3a94-46e1-b899-4b2979f91114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-a9a30651-48bd-4aea-8ba7-38c20edcd60d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:47 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ec8c590d-8cb1-4c05-b327-bdace4772e21 tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-a9a30651-48bd-4aea-8ba7-38c20edcd60d" acquired by "delete_volume" :: waited 0.020s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[30173790-ac33-4aed-be2d-6d8be7c91fe2]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:47 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d
Sep 30 18:11:47 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot adc0d40c-739f-454d-93a4-daca0edfdb80 of volume 35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab8b56-139b-4ab8-bcc4-e572042ea719]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:47 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d" returned: 0 in 0.393s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:47 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d
Sep 30 18:11:47 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:47 devstack sudo[108487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d
Sep 30 18:11:47 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:47 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a9a30651-48bd-4aea-8ba7-38c20edcd60d" returned: 0 in 0.258s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-a9a30651-48bd-4aea-8ba7-38c20edcd60d" released by "delete_volume" :: held 0.720s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:47 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d" returned: 0 in 0.399s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:47 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 1G
Sep 30 18:11:47 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Created reservations ['16b75fb0-58bd-4c56-9edb-65a319a5ba4b', '6c04d11c-774d-4ada-9796-c13292455e0d', '573e1424-3ebc-4ba1-a3d6-80c3ff902d6f', '21b0bccc-23c4-4c2c-869a-7b7a2daf5693'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:47 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:47 devstack sudo[108498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:47 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:48 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.268s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:48 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Deleted volume successfully.
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-e6ca65f5-6746-4a92-9e24-17b1fbbc89ba tempest-ProjectReaderTests-1444058996 None] Lock "cinder-a9a30651-48bd-4aea-8ba7-38c20edcd60d-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:48 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 1G" returned: 0 in 0.471s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35329f4e-93df-4748-a17b-70bb9b10931d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:48 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35329f4e-93df-4748-a17b-70bb9b10931d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80
Sep 30 18:11:48 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:48 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (5df2ec2b-7ba9-4fe5-98ec-fe65bdd50cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efea1170-4b27-41fa-a4d8-3db2ebd533be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35329f4e-93df-4748-a17b-70bb9b10931d -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80" returned: 0 in 0.360s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:48 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 is being set with open permissions: ugo+rw
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:48 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efea1170-4b27-41fa-a4d8-3db2ebd533be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505763778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a756939-13b0-4f01-acbd-4595ba25189c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:49Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:48 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84750799-7194-4013-99f9-5def92dfda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84750799-7194-4013-99f9-5def92dfda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93991db-bf49-4282-8ce0-93753dcf8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93991db-bf49-4282-8ce0-93753dcf8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a756939-13b0-4f01-acbd-4595ba25189c', 'volume_name': 'volume-4a756939-13b0-4f01-acbd-4595ba25189c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9e1ddf-4a34-4a0c-9be4-0ccb101220bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9e1ddf-4a34-4a0c-9be4-0ccb101220bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbccae2-2719-43fb-9075-8b006634d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:48 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Volume 4a756939-13b0-4f01-acbd-4595ba25189c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a756939-13b0-4f01-acbd-4595ba25189c', 'volume_size': 1}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:48 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:48 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:48 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info
Sep 30 18:11:48 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:49 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:49 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info is being set with open permissions: ugo+rw
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:49 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info
Sep 30 18:11:49 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:49 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.info" returned: 0 in 0.265s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505763778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a756939-13b0-4f01-acbd-4595ba25189c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1d0ec6ab54514979776a63e727914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:49Z,use_quota=True,user_id='a3859084f2c541f9a46680ee23960e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Creating volume 4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:49 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:49 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c 1073741824
Sep 30 18:11:49 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:49 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-930b4911-81c4-4957-8933-0be10ac425d3 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:11:49 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c 1073741824" returned: 0 in 0.415s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=169,cinder:UPDATE=206,cinder:INSERT=71,cinder:DELETE=11 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=175,cinder:INSERT=51,cinder:UPDATE=224,cinder:DELETE=26 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:11:49 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:49 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c
Sep 30 18:11:49 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:50 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c" returned: 0 in 0.236s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbccae2-2719-43fb-9075-8b006634d38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a756939-13b0-4f01-acbd-4595ba25189c', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a832040a-6683-4cf1-9c13-4e0f782d56be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:50 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Volume volume-4a756939-13b0-4f01-acbd-4595ba25189c (4a756939-13b0-4f01-acbd-4595ba25189c): created successfully
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a832040a-6683-4cf1-9c13-4e0f782d56be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Flow 'volume_create_manager' (5df2ec2b-7ba9-4fe5-98ec-fe65bdd50cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:50 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-24632321-9416-4c4a-99fa-e3cb2f89d228 tempest-ProjectReaderTests-1444058996 None] Created volume successfully.
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-adc0d40c-739f-454d-93a4-daca0edfdb80-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-adc0d40c-739f-454d-93a4-daca0edfdb80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-35329f4e-93df-4748-a17b-70bb9b10931d" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-35329f4e-93df-4748-a17b-70bb9b10931d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-adc0d40c-739f-454d-93a4-daca0edfdb80" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-adc0d40c-739f-454d-93a4-daca0edfdb80" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot adc0d40c-739f-454d-93a4-daca0edfdb80 of volume 35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864c12e-161e-4ed3-8a23-8622cff56ebe]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:50 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80
Sep 30 18:11:50 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Creating offline snapshot 81463eb1-de88-471e-8a43-ee85bfa1aa32 of volume 4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da25952-e62e-4a19-b1bb-499a4d212d1d]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:50 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:51 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80" returned: 0 in 0.371s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35329f4e-93df-4748-a17b-70bb9b10931d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:51 devstack sudo[108528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c
Sep 30 18:11:51 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdedbfa-9ecb-4ffa-ab36-3c51df786bd8]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:51 devstack sudo[108533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d
Sep 30 18:11:51 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:51 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c" returned: 0 in 0.361s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:51 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 1G
Sep 30 18:11:51 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:51 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d" returned: 0 in 0.362s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:51 devstack sudo[108543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80
Sep 30 18:11:51 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:51 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 1G" returned: 0 in 0.414s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a756939-13b0-4f01-acbd-4595ba25189c -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:51 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a756939-13b0-4f01-acbd-4595ba25189c -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32
Sep 30 18:11:51 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:51 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80" returned: 0 in 0.354s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:51 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80
Sep 30 18:11:51 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:51 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a756939-13b0-4f01-acbd-4595ba25189c -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32" returned: 0 in 0.304s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:51 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 is being set with open permissions: ugo+rw
Sep 30 18:11:51 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:52 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32
Sep 30 18:11:52 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:52 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d.adc0d40c-739f-454d-93a4-daca0edfdb80" returned: 0 in 0.269s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-adc0d40c-739f-454d-93a4-daca0edfdb80" released by "_delete_snapshot" :: held 1.472s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-35329f4e-93df-4748-a17b-70bb9b10931d" released by "delete_snapshot" :: held 1.497s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Created reservations ['a56e1a3f-ff20-499c-a4eb-ed888a740107', '2aa4459d-b665-47fa-ad69-a5cfeede65e0', 'ca16b006-c0d3-41b8-9f77-7bca43932c7b', '953699d4-b603-48ae-96b0-f530516cee0e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-76a4c765-dd49-437c-a67a-396e7787a1f0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-adc0d40c-739f-454d-93a4-daca0edfdb80-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:52 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:52 devstack sudo[108563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info
Sep 30 18:11:52 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:52 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info" returned: 0 in 0.246s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:52 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info is being set with open permissions: ugo+rw
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:52 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info
Sep 30 18:11:52 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-35329f4e-93df-4748-a17b-70bb9b10931d-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-35329f4e-93df-4748-a17b-70bb9b10931d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-35329f4e-93df-4748-a17b-70bb9b10931d" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:52 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.info" returned: 0 in 0.263s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-35329f4e-93df-4748-a17b-70bb9b10931d" acquired by "delete_volume" :: waited 0.036s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97c7e46-b279-4cda-a8f4-499c59ea8595]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:52 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2883bc08-7679-4f08-a1e3-b841a84dc65a tempest-ProjectReaderTests-1444058996 None] Create snapshot completed successfully
Sep 30 18:11:52 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d
Sep 30 18:11:52 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:52 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-81463eb1-de88-471e-8a43-ee85bfa1aa32-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-81463eb1-de88-471e-8a43-ee85bfa1aa32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-4a756939-13b0-4f01-acbd-4595ba25189c" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-4a756939-13b0-4f01-acbd-4595ba25189c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-81463eb1-de88-471e-8a43-ee85bfa1aa32" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-81463eb1-de88-471e-8a43-ee85bfa1aa32" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Deleting offline snapshot 81463eb1-de88-471e-8a43-ee85bfa1aa32 of volume 4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] snapshot_file for this snap is: volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526f16d-80a4-40bb-969d-6753d9b32882]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:53 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32
Sep 30 18:11:53 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:53 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d" returned: 0 in 0.374s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:53 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d
Sep 30 18:11:53 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:53 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32" returned: 0 in 0.362s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a756939-13b0-4f01-acbd-4595ba25189c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:53 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-35329f4e-93df-4748-a17b-70bb9b10931d" returned: 0 in 0.260s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f8861f-876a-4354-9ce5-c4146cebc573]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-35329f4e-93df-4748-a17b-70bb9b10931d" released by "delete_volume" :: held 0.713s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Created reservations ['991848f4-349a-45e4-9c78-2b678d619b7d', '50596fed-26a8-4e9f-843b-97bf4856b7c3', 'af855f6a-72e2-4037-a379-6c4e2ae59b06', '401a2e9f-841a-4812-ae6e-a966b7087102'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:53 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c
Sep 30 18:11:53 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:53 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:53 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:53 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:53 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:53 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:11:53 devstack sudo[108591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32
Sep 30 18:11:53 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:53 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-c4738bc4-93c7-4613-a5a8-c24376baf112 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-35329f4e-93df-4748-a17b-70bb9b10931d-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:54 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32" returned: 0 in 0.461s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:54 devstack sudo[108632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32
Sep 30 18:11:54 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (081dc9fa-a99c-494a-8e97-bb445a9484e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fd2357-ff13-46bc-a338-604c88754085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fd2357-ff13-46bc-a338-604c88754085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1524583478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38931df2-443a-4840-899b-a57133c82dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:54Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0ce0d1-9979-4f86-a1af-e1ee2ac91915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0ce0d1-9979-4f86-a1af-e1ee2ac91915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6130fdab-1a90-4364-8aa2-94da34d9b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6130fdab-1a90-4364-8aa2-94da34d9b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38931df2-443a-4840-899b-a57133c82dc5', 'volume_name': 'volume-38931df2-443a-4840-899b-a57133c82dc5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a97fffd-a262-4d28-b13a-5117df0bb3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a97fffd-a262-4d28-b13a-5117df0bb3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2642b59d-2b1f-485c-ac11-d6fdb5bcdb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:54 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Volume 38931df2-443a-4840-899b-a57133c82dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38931df2-443a-4840-899b-a57133c82dc5', 'volume_size': 1}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1524583478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38931df2-443a-4840-899b-a57133c82dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:11:54Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Creating volume 38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:11:54 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:54 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 1073741824
Sep 30 18:11:54 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:54 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c.81463eb1-de88-471e-8a43-ee85bfa1aa32" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-81463eb1-de88-471e-8a43-ee85bfa1aa32" released by "_delete_snapshot" :: held 1.626s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-4a756939-13b0-4f01-acbd-4595ba25189c" released by "delete_snapshot" :: held 1.646s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Created reservations ['53cd36be-2160-45f7-b5f7-6cd5de891f7a', '9d183632-e219-4fb7-bd8a-0ec70c1d55ea', 'e572b127-9cd1-4410-887c-6a48a9408bdb', '365d9841-62e5-4cd1-9abd-a194dce3df2c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:54 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Delete snapshot completed successfully.
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-10c40363-cc13-4105-a419-65d77f2ba941 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-81463eb1-de88-471e-8a43-ee85bfa1aa32-delete_snapshot" released by "delete_snapshot" :: held 1.771s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:54 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:54 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 1073741824" returned: 0 in 0.440s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:55 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5
Sep 30 18:11:55 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-4a756939-13b0-4f01-acbd-4595ba25189c-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-4a756939-13b0-4f01-acbd-4595ba25189c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "cinder-quobyte-4a756939-13b0-4f01-acbd-4595ba25189c" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-4a756939-13b0-4f01-acbd-4595ba25189c" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:55 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5" returned: 0 in 0.264s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2642b59d-2b1f-485c-ac11-d6fdb5bcdb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38931df2-443a-4840-899b-a57133c82dc5', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a56dfa-fda2-4dc2-bac3-601fbfa0d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ccd8b3-f9ff-4bbd-a133-704599445060]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:55 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Volume volume-38931df2-443a-4840-899b-a57133c82dc5 (38931df2-443a-4840-899b-a57133c82dc5): created successfully
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a56dfa-fda2-4dc2-bac3-601fbfa0d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (081dc9fa-a99c-494a-8e97-bb445a9484e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:11:55 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-36561d4e-6966-49a5-b8c8-6c6b4cf56d6f tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:11:55 devstack sudo[108643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c
Sep 30 18:11:55 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot 3ce3a79f-0595-4d50-8956-1620bb4ee12b of volume 38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b7d75-5cd1-4ce4-bb6f-2a14de56e560]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:55 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c" returned: 0 in 0.382s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:55 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c
Sep 30 18:11:55 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:55 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5
Sep 30 18:11:55 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:55 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-4a756939-13b0-4f01-acbd-4595ba25189c" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:55 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-quobyte-4a756939-13b0-4f01-acbd-4595ba25189c" released by "delete_volume" :: held 0.713s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Created reservations ['46223c43-1544-447d-aae3-016c205b385b', 'c437d7e1-647d-4bf6-ad4c-61fa7501a722', '15bbf658-40b0-42ea-9e8a-997288841952', '541ccc00-3392-4f78-b98f-bb054341b647'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:11:56 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5" returned: 0 in 0.372s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:56 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b 1G
Sep 30 18:11:56 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:56 devstack sudo[108658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:11:56 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:56 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.243s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:11:56 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Deleted volume successfully.
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d7ecf819-688c-4aa4-bdb4-e37d00302e05 tempest-ProjectReaderTests-1444058996 None] Lock "cinder-4a756939-13b0-4f01-acbd-4595ba25189c-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:11:56 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b 1G" returned: 0 in 0.495s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38931df2-443a-4840-899b-a57133c82dc5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:56 devstack sudo[108666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38931df2-443a-4840-899b-a57133c82dc5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b
Sep 30 18:11:56 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:56 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38931df2-443a-4840-899b-a57133c82dc5 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b" returned: 0 in 0.298s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:56 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b is being set with open permissions: ugo+rw
Sep 30 18:11:56 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:56 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b
Sep 30 18:11:56 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:57 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b" returned: 0 in 0.241s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:57 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info
Sep 30 18:11:57 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:57 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info" returned: 0 in 0.284s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:57 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info is being set with open permissions: ugo+rw
Sep 30 18:11:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:57 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info
Sep 30 18:11:57 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:57 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.info" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:57 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:11:57 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7457509a-59b6-44e0-b977-a391d88fd720 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-3ce3a79f-0595-4d50-8956-1620bb4ee12b-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-3ce3a79f-0595-4d50-8956-1620bb4ee12b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-38931df2-443a-4840-899b-a57133c82dc5" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-38931df2-443a-4840-899b-a57133c82dc5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-3ce3a79f-0595-4d50-8956-1620bb4ee12b" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-3ce3a79f-0595-4d50-8956-1620bb4ee12b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot 3ce3a79f-0595-4d50-8956-1620bb4ee12b of volume 38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad1b8b6-163d-49aa-ab12-a69a2c6bc453]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:58 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:58 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b
Sep 30 18:11:58 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:59 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b" returned: 0 in 0.367s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:59 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38931df2-443a-4840-899b-a57133c82dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:11:59 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dbcc16-d2be-41d8-b18a-3afab5f73b68]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:11:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:59 devstack sudo[108685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5
Sep 30 18:11:59 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:11:59 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root
Sep 30 18:11:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5" returned: 0 in 0.377s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:11:59 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:11:59 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b
Sep 30 18:11:59 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:00 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b" returned: 0 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:00 devstack sudo[108695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b
Sep 30 18:12:00 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:00 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5.3ce3a79f-0595-4d50-8956-1620bb4ee12b" returned: 0 in 0.262s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-3ce3a79f-0595-4d50-8956-1620bb4ee12b" released by "_delete_snapshot" :: held 1.489s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-38931df2-443a-4840-899b-a57133c82dc5" released by "delete_snapshot" :: held 1.512s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Created reservations ['e6e6de93-84af-48db-8dab-806bbc2eb36e', 'aade472a-0165-4b7a-a270-fb6e95cb0394', '06f17279-4a99-4cdb-8537-06390d2421c9', '6191eafc-d7f1-4f5d-b443-3952fc75689c'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:00 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-138244c8-da0a-4758-8d27-b08453e08be4 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-3ce3a79f-0595-4d50-8956-1620bb4ee12b-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-38931df2-443a-4840-899b-a57133c82dc5-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:00 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Lock "cinder-38931df2-443a-4840-899b-a57133c82dc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-38931df2-443a-4840-899b-a57133c82dc5" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-38931df2-443a-4840-899b-a57133c82dc5" acquired by "delete_volume" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81744f-61a7-4840-a2e8-721df90f1936]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:01 devstack sudo[108698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5
Sep 30 18:12:01 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:01 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5" returned: 0 in 0.412s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:01 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5
Sep 30 18:12:01 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:01 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-38931df2-443a-4840-899b-a57133c82dc5" returned: 0 in 0.257s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-38931df2-443a-4840-899b-a57133c82dc5" released by "delete_volume" :: held 0.747s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Created reservations ['27768754-0a73-45c8-8dee-78128827b2ea', 'ed16be21-adf6-40fe-b70e-0f1b04f7f60e', 'b3824729-b8ef-42ab-9638-8b1ebd215259', '526b154d-a7d3-4b33-a155-0ed2b0a5f58a'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:01 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:01 devstack sudo[108708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:12:01 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:02 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.297s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:12:02 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-9a3ad4da-944f-45f2-8e09-e9dd439a043e tempest-ProjectMemberTests-2136822435 None] Lock "cinder-38931df2-443a-4840-899b-a57133c82dc5-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (8a3b61aa-31da-4d9a-aee4-99f367e25a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986c6b94-3037-44da-b106-44619875aeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986c6b94-3037-44da-b106-44619875aeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100597421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2834862-40c0-4875-a5d8-722531830c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:03Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c19d41a-729b-4913-b9cf-afadbd9fce21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c19d41a-729b-4913-b9cf-afadbd9fce21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d96700-1a6c-42a7-ae49-14e6bb09b0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d96700-1a6c-42a7-ae49-14e6bb09b0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2834862-40c0-4875-a5d8-722531830c84', 'volume_name': 'volume-e2834862-40c0-4875-a5d8-722531830c84', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc50cf3-b8ce-4260-8ea7-047460b3078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc50cf3-b8ce-4260-8ea7-047460b3078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d09925b-36a3-4390-a8e4-6adc60faeb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:02 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Volume e2834862-40c0-4875-a5d8-722531830c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2834862-40c0-4875-a5d8-722531830c84', 'volume_size': 1}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100597421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2834862-40c0-4875-a5d8-722531830c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:03Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Creating volume e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:12:02 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:12:02 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:02 devstack sudo[108711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 1073741824
Sep 30 18:12:02 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:03 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 1073741824" returned: 0 in 0.448s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:03 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84
Sep 30 18:12:03 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:03 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84" returned: 0 in 0.268s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d09925b-36a3-4390-a8e4-6adc60faeb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2834862-40c0-4875-a5d8-722531830c84', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f7454e-c242-45f7-954e-e5aa6c0b747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:03 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Volume volume-e2834862-40c0-4875-a5d8-722531830c84 (e2834862-40c0-4875-a5d8-722531830c84): created successfully
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f7454e-c242-45f7-954e-e5aa6c0b747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (8a3b61aa-31da-4d9a-aee4-99f367e25a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:03 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-b75882f7-6cb4-4102-8101-02485f840452 tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot 3c007021-010b-48f8-af42-a066e3fd4ce8 of volume e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc4d7f-8673-421a-9a16-d8d5eee39e5a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:03 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:03 devstack sudo[108720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84
Sep 30 18:12:03 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:04 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84" returned: 0 in 0.391s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:04 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 1G
Sep 30 18:12:04 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:04 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 1G" returned: 0 in 0.438s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:04 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2834862-40c0-4875-a5d8-722531830c84 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:04 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2834862-40c0-4875-a5d8-722531830c84 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8
Sep 30 18:12:04 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:04 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2834862-40c0-4875-a5d8-722531830c84 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8" returned: 0 in 0.304s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:05 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 is being set with open permissions: ugo+rw
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:05 devstack sudo[108737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8
Sep 30 18:12:05 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:05 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8" returned: 0 in 0.246s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:05 devstack sudo[108740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info
Sep 30 18:12:05 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:05 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info" returned: 0 in 0.272s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:05 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info is being set with open permissions: ugo+rw
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:05 devstack sudo[108743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info
Sep 30 18:12:05 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:05 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.info" returned: 0 in 0.266s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:05 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:05 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-ae012ca6-39c1-4bda-9107-c2fa614c6249 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:12:06 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-3c007021-010b-48f8-af42-a066e3fd4ce8-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-3c007021-010b-48f8-af42-a066e3fd4ce8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-e2834862-40c0-4875-a5d8-722531830c84" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-e2834862-40c0-4875-a5d8-722531830c84" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-3c007021-010b-48f8-af42-a066e3fd4ce8" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-3c007021-010b-48f8-af42-a066e3fd4ce8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot 3c007021-010b-48f8-af42-a066e3fd4ce8 of volume e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef31fb6-fa00-41bc-8dd3-e7673272de6b]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:07 devstack sudo[108747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8
Sep 30 18:12:07 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:07 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2834862-40c0-4875-a5d8-722531830c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4257feb2-898f-4306-8c9c-dddb5e47a53a]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:07 devstack sudo[108752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84
Sep 30 18:12:07 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:07 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84" returned: 0 in 0.346s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:07 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:07 devstack sudo[108758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8
Sep 30 18:12:07 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:08 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8" returned: 0 in 0.321s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:08 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8
Sep 30 18:12:08 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:08 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84.3c007021-010b-48f8-af42-a066e3fd4ce8" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-3c007021-010b-48f8-af42-a066e3fd4ce8" released by "_delete_snapshot" :: held 1.364s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-e2834862-40c0-4875-a5d8-722531830c84" released by "delete_snapshot" :: held 1.386s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Created reservations ['0c0d6f3e-a36b-4508-9e46-b7669e5a77b8', '490e1395-fa03-465a-9bba-8b44ba0cac2b', '1d692922-b563-4c8d-b9f7-a759895adb5c', '535390e3-1a8f-4074-9fde-0840c7d0f7d7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:08 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:12:08 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-711e3b3c-4a2a-4fe6-85c0-e16b1308a831 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-3c007021-010b-48f8-af42-a066e3fd4ce8-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-e2834862-40c0-4875-a5d8-722531830c84-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-e2834862-40c0-4875-a5d8-722531830c84-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-e2834862-40c0-4875-a5d8-722531830c84" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-e2834862-40c0-4875-a5d8-722531830c84" acquired by "delete_volume" :: waited 0.019s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9edfd9-c4e0-4e24-a054-69e98a0fc197]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:09 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84
Sep 30 18:12:09 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:09 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84" returned: 0 in 0.346s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:09 devstack sudo[108772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84
Sep 30 18:12:09 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:09 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-e2834862-40c0-4875-a5d8-722531830c84" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-e2834862-40c0-4875-a5d8-722531830c84" released by "delete_volume" :: held 0.641s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Created reservations ['c7d53f2e-ba98-4914-a0b0-64c9dc934a49', '329b29ff-ea55-4d1f-8e61-c44071a048b2', '1c97dbd7-4c5f-4d8b-8590-b2b9100151bb', 'c534ef07-6c4e-4c60-8d25-ed8481b2a46e'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:09 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:09 devstack sudo[108775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:12:09 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:10 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:12:10 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-d5604f72-9f8b-4d04-9565-ffb2afddffe0 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-e2834862-40c0-4875-a5d8-722531830c84-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (0a509060-70c6-4216-902c-001b0b94e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9e8ba5-edbe-49db-a138-0e10ea31c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9e8ba5-edbe-49db-a138-0e10ea31c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475835823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:11Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdaf0cf-7141-443a-9f4a-1d5f3c39a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdaf0cf-7141-443a-9f4a-1d5f3c39a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87663e3-8990-40d4-b9e0-44fa65f1f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87663e3-8990-40d4-b9e0-44fa65f1f622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43', 'volume_name': 'volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78582f4c-a7d2-4f58-b157-76cc7025d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78582f4c-a7d2-4f58-b157-76cc7025d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d18381d-98f0-4979-92b7-86c0c79c6b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:10 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Volume 2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43', 'volume_size': 1}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475835823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:11Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Creating volume 2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:12:10 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:12:10 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:10 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 1073741824
Sep 30 18:12:10 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:11 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 1073741824" returned: 0 in 0.401s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:11 devstack sudo[108784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43
Sep 30 18:12:11 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:11 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d18381d-98f0-4979-92b7-86c0c79c6b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75110d6d-0a4d-404c-a913-1c9fa136f420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:11 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Volume volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 (2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43): created successfully
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75110d6d-0a4d-404c-a913-1c9fa136f420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (0a509060-70c6-4216-902c-001b0b94e13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:11 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-92e1b3c2-1d36-4ef5-a816-01b3b5271d5c tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot b4886258-238c-4079-8a37-89d6584d4d73 of volume 2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a1022f-56af-4e84-8b06-9068d4a12ecf]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:11 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:12 devstack sudo[108787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43
Sep 30 18:12:12 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:12 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" returned: 0 in 0.361s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:12 devstack sudo[108792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 1G
Sep 30 18:12:12 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:12 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 1G" returned: 0 in 0.387s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:12 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73
Sep 30 18:12:12 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:12 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73" returned: 0 in 0.286s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:12 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 is being set with open permissions: ugo+rw
Sep 30 18:12:12 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:12 devstack sudo[108803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73
Sep 30 18:12:12 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:13 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73" returned: 0 in 0.233s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:13 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info
Sep 30 18:12:13 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:13 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info" returned: 0 in 0.237s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:13 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info is being set with open permissions: ugo+rw
Sep 30 18:12:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:13 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info
Sep 30 18:12:13 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:13 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.info" returned: 0 in 0.243s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:13 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:13 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-d4433a94-a265-4b67-b462-3643c4ada3a2 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-b4886258-238c-4079-8a37-89d6584d4d73-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Lock "cinder-b4886258-238c-4079-8a37-89d6584d4d73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-b4886258-238c-4079-8a37-89d6584d4d73" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-b4886258-238c-4079-8a37-89d6584d4d73" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot b4886258-238c-4079-8a37-89d6584d4d73 of volume 2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d22b4f8-357c-4754-b682-2abd91b4e6cb]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:14 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73
Sep 30 18:12:14 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:14 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064c4db-0b9c-4184-802f-86fc01866873]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:14 devstack sudo[108817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43
Sep 30 18:12:14 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:14 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" returned: 0 in 0.347s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:14 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:14 devstack sudo[108822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73
Sep 30 18:12:14 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:15 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73" returned: 0 in 0.322s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:15 devstack sudo[108827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73
Sep 30 18:12:15 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:15 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43.b4886258-238c-4079-8a37-89d6584d4d73" returned: 0 in 0.238s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-b4886258-238c-4079-8a37-89d6584d4d73" released by "_delete_snapshot" :: held 1.351s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" released by "delete_snapshot" :: held 1.373s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Created reservations ['fdfb3bda-655f-4f63-b998-ecac050fd165', '7b9e2f61-cf78-40b8-b20e-d42dcc0f3d5f', '710a8eb2-b313-416f-86c6-8f4d169cff7d', 'd0a72ef1-af44-4af7-bc45-361607264ea4'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:15 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:12:15 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f2f4565d-08b2-498e-8012-756533da217c tempest-ProjectMemberTests-2136822435 None] Lock "cinder-b4886258-238c-4079-8a37-89d6584d4d73-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" acquired by "delete_volume" :: waited 0.013s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb4264-a76b-4359-9152-c4b8520ced65]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:16 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43
Sep 30 18:12:16 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:16 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" returned: 0 in 0.357s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:16 devstack sudo[108837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43
Sep 30 18:12:16 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:16 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" returned: 0 in 0.241s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43" released by "delete_volume" :: held 0.658s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Created reservations ['cae1f56b-eb28-4120-89b7-434d9269cf80', '4ddc3917-45b7-453b-b203-22255eee46cf', '41d9b479-6be1-4f82-b419-9665df128286', '3ae7d724-d0fb-402f-a547-d319fc8f9b99'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:16 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:17 devstack sudo[108840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:12:17 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:17 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.234s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:12:17 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-60b607ab-1832-46ee-afa5-6a82e47a0b11 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-2ffd0f66-8a8a-4f0c-b4f1-ab6d41806e43-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (9c082b48-17bf-4c69-a052-d877a66670aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6597c0-6f57-4335-86cf-54e058e862d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6597c0-6f57-4335-86cf-54e058e862d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914169473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1c4bde-b725-4b17-a21a-a8d160a9f3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:18Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d564c12a-3b25-4d76-9de1-4136da53741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d564c12a-3b25-4d76-9de1-4136da53741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ca8763-1d66-4903-9414-59e224afd4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ca8763-1d66-4903-9414-59e224afd4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1c4bde-b725-4b17-a21a-a8d160a9f3b9', 'volume_name': 'volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2d44c2-a460-451d-93b5-a092e4d08ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2d44c2-a460-451d-93b5-a092e4d08ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0f2ed1-0cc1-4067-8107-60206c09d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:17 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Volume 8e1c4bde-b725-4b17-a21a-a8d160a9f3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9', 'volume_size': 1}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914169473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1c4bde-b725-4b17-a21a-a8d160a9f3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:18Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Creating volume 8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:12:17 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:12:17 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:17 devstack sudo[108843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 1073741824
Sep 30 18:12:17 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:18 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 1073741824" returned: 0 in 0.426s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:18 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9
Sep 30 18:12:18 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:18 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" returned: 0 in 0.254s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0f2ed1-0cc1-4067-8107-60206c09d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090b2102-7b15-4248-bceb-ae6655a24afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:18 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Volume volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 (8e1c4bde-b725-4b17-a21a-a8d160a9f3b9): created successfully
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090b2102-7b15-4248-bceb-ae6655a24afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (9c082b48-17bf-4c69-a052-d877a66670aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:18 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-2ba0e5c1-ddf7-4b9f-bb39-5b490e67febd tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot d28687c3-628d-4b1c-afb7-408bdbf742fb of volume 8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2680932f-879e-4f11-ac01-3b2786e748f5]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:18 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:19 devstack sudo[108852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9
Sep 30 18:12:19 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:19 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" returned: 0 in 0.367s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:19 devstack sudo[108857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb 1G
Sep 30 18:12:19 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:19 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb 1G" returned: 0 in 0.387s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:19 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:19 devstack sudo[108863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb
Sep 30 18:12:19 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:20 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb" returned: 0 in 0.302s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:20 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb is being set with open permissions: ugo+rw
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:20 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb
Sep 30 18:12:20 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:20 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb" returned: 0 in 0.239s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:20 devstack sudo[108871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info
Sep 30 18:12:20 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:20 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info" returned: 0 in 0.255s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:20 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info is being set with open permissions: ugo+rw
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:20 devstack sudo[108874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info
Sep 30 18:12:20 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:20 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.info" returned: 0 in 0.249s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:20 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:20 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-76284dfc-ba53-433b-8b2d-96125f89ff75 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-d28687c3-628d-4b1c-afb7-408bdbf742fb-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Lock "cinder-d28687c3-628d-4b1c-afb7-408bdbf742fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-d28687c3-628d-4b1c-afb7-408bdbf742fb" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-d28687c3-628d-4b1c-afb7-408bdbf742fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot d28687c3-628d-4b1c-afb7-408bdbf742fb of volume 8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c527197-3ffa-4308-8810-d8fb5b816fee]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:21 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb
Sep 30 18:12:21 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:21 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb" returned: 0 in 0.352s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adaa0c6-723e-4269-9084-00371e400c90]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:21 devstack sudo[108882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9
Sep 30 18:12:21 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:21 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" returned: 0 in 0.345s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:21 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:21 devstack sudo[108887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb
Sep 30 18:12:21 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:22 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb" returned: 0 in 0.342s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:22 devstack sudo[108892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb
Sep 30 18:12:22 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:22 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9.d28687c3-628d-4b1c-afb7-408bdbf742fb" returned: 0 in 0.232s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-d28687c3-628d-4b1c-afb7-408bdbf742fb" released by "_delete_snapshot" :: held 1.368s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" released by "delete_snapshot" :: held 1.393s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Created reservations ['b3297a31-52ea-44aa-8c0a-af5409dec37d', '85225c5c-c48a-48fa-a6a2-c4284969b0ab', '25fbba43-51d6-48d1-a598-5218e2c2287b', 'c72c4597-bdfe-45a1-b660-3c0f2e275eb7'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:22 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:12:22 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-fd76812e-0beb-4fd5-8e88-a5b5e71f82ae tempest-ProjectMemberTests-2136822435 None] Lock "cinder-d28687c3-628d-4b1c-afb7-408bdbf742fb-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" acquired by "delete_volume" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7409a93-5a41-49ed-aa77-88a3765a545e]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:23 devstack sudo[108895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9
Sep 30 18:12:23 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:23 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" returned: 0 in 0.354s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:23 devstack sudo[108900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9
Sep 30 18:12:23 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:23 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:23 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9" released by "delete_volume" :: held 0.665s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Created reservations ['4c9140f3-cfb5-47ac-984e-0495a1df10e3', '435ec17b-d30e-42e0-af36-efb1341615b3', '36dbc3b8-5875-4cca-b69f-d510e1de7ab4', 'ab20fad2-dbfc-4c1b-a50e-8d1f0219e2a6'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:24 devstack sudo[108903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:12:24 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:24 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.236s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:12:24 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-f5b366e7-ceed-47cf-bdf4-1d7cfc8e4d91 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-8e1c4bde-b725-4b17-a21a-a8d160a9f3b9-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87418) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (9382443c-5923-4087-80b9-923f3a3ace93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51c1e4b-b050-4878-b7c7-f885ce4086c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51c1e4b-b050-4878-b7c7-f885ce4086c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425689728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a921e59f-8102-4303-b860-3e35226c878e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:25Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e190e1d-93c8-4ab4-8ffa-3ade46f84838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e190e1d-93c8-4ab4-8ffa-3ade46f84838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a234194-4f07-421d-812e-d28e463f8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a234194-4f07-421d-812e-d28e463f8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a921e59f-8102-4303-b860-3e35226c878e', 'volume_name': 'volume-a921e59f-8102-4303-b860-3e35226c878e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcff1d61-29d8-4eb5-bd3b-19848fc56a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcff1d61-29d8-4eb5-bd3b-19848fc56a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3f89a8-b9b9-46c1-bf1f-3452422c659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:24 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Volume a921e59f-8102-4303-b860-3e35226c878e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a921e59f-8102-4303-b860-3e35226c878e', 'volume_size': 1}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73c14a0b7bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-30T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425689728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a921e59f-8102-4303-b860-3e35226c878e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b05d160564398a5128f8804c9da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T16:12:25Z,use_quota=True,user_id='a0fb3a033a8641028937e3e49090182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc2def28-bb15-443f-a32c-046cc42075f3),volume_type_id=fc2def28-bb15-443f-a32c-046cc42075f3)}" {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Creating volume a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Selected osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f as target Quobyte volume. {{(pid=87418) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 30 18:12:24 devstack cinder-volume[87418]: INFO cinder.volume.drivers.remotefs [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] casted to osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f
Sep 30 18:12:24 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e 1073741824 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:24 devstack sudo[108906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e 1073741824
Sep 30 18:12:24 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:25 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e 1073741824" returned: 0 in 0.403s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:25 devstack sudo[108911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e
Sep 30 18:12:25 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:25 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e" returned: 0 in 0.230s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'} {{(pid=87418) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3f89a8-b9b9-46c1-bf1f-3452422c659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a921e59f-8102-4303-b860-3e35226c878e', 'volume_size': 1}' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b19c74-6ceb-4057-9d8c-fab5a09dfcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 30 18:12:25 devstack cinder-volume[87418]: INFO cinder.volume.flows.manager.create_volume [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Volume volume-a921e59f-8102-4303-b860-3e35226c878e (a921e59f-8102-4303-b860-3e35226c878e): created successfully
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b19c74-6ceb-4057-9d8c-fab5a09dfcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87418) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Flow 'volume_create_manager' (9382443c-5923-4087-80b9-923f3a3ace93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87418) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 30 18:12:25 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-cf4a23a8-3af5-4c7c-a66d-07a9da33e171 tempest-ProjectMemberTests-2136822435 None] Created volume successfully.
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:25 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Creating offline snapshot d737b1d7-e117-4e92-960a-675f8184f66d of volume a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 30 18:12:26 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f00ee-7a6f-4ecb-942e-ccde4c157fee]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:26 devstack sudo[108914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e
Sep 30 18:12:26 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:26 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e" returned: 0 in 0.341s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d 1G {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:26 devstack sudo[108919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d 1G
Sep 30 18:12:26 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:26 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d 1G" returned: 0 in 0.395s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:26 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a921e59f-8102-4303-b860-3e35226c878e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:26 devstack sudo[108925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a921e59f-8102-4303-b860-3e35226c878e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d
Sep 30 18:12:26 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:27 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a921e59f-8102-4303-b860-3e35226c878e -F qcow2 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d" returned: 0 in 0.288s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:27 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d is being set with open permissions: ugo+rw
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:27 devstack sudo[108931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d
Sep 30 18:12:27 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:27 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d" returned: 0 in 0.231s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:27 devstack sudo[108934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info
Sep 30 18:12:27 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:27 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info" returned: 0 in 0.245s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:27 devstack cinder-volume[87418]: WARNING cinder.volume.drivers.remotefs [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info is being set with open permissions: ugo+rw
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:27 devstack sudo[108937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info
Sep 30 18:12:27 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:27 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.info" returned: 0 in 0.250s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:27 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:27 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-19517781-6222-465d-8d23-e08237b128c9 tempest-ProjectMemberTests-2136822435 None] Create snapshot completed successfully
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-d737b1d7-e117-4e92-960a-675f8184f66d-delete_snapshot" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Lock "cinder-d737b1d7-e117-4e92-960a-675f8184f66d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-a921e59f-8102-4303-b860-3e35226c878e" by "delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-a921e59f-8102-4303-b860-3e35226c878e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-d737b1d7-e117-4e92-960a-675f8184f66d" by "_delete_snapshot" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-d737b1d7-e117-4e92-960a-675f8184f66d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Deleting offline snapshot d737b1d7-e117-4e92-960a-675f8184f66d of volume a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] snapshot_file for this snap is: volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d {{(pid=87418) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a2af83-67ab-410f-a8b8-8c43226749b6]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:28 devstack sudo[108940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d
Sep 30 18:12:28 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:28 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d" returned: 0 in 0.352s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.remotefs [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a921e59f-8102-4303-b860-3e35226c878e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87418) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[336914ef-4434-434d-b1ef-bf89c77b8bc9]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:28 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:28 devstack sudo[108945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e
Sep 30 18:12:28 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:29 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e" returned: 0 in 0.351s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:29 devstack sudo[108950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d
Sep 30 18:12:29 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:29 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d" returned: 0 in 0.326s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:29 devstack sudo[108956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d
Sep 30 18:12:29 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:29 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e.d737b1d7-e117-4e92-960a-675f8184f66d" returned: 0 in 0.240s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-d737b1d7-e117-4e92-960a-675f8184f66d" released by "_delete_snapshot" :: held 1.366s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-a921e59f-8102-4303-b860-3e35226c878e" released by "delete_snapshot" :: held 1.387s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Created reservations ['168d04d9-cb62-437c-95e2-b880156058bc', '9d1c6001-abc6-4f03-ba4f-77050e0e0eb0', 'b1a72c5a-d751-42ab-a0d7-58d30479a53a', '5fdebb87-9e47-463a-a76f-2c4bbcf915cc'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:29 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Delete snapshot completed successfully.
Sep 30 18:12:29 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-7502f8d4-72e6-4bab-8999-53159121ee7d tempest-ProjectMemberTests-2136822435 None] Lock "cinder-d737b1d7-e117-4e92-960a-675f8184f66d-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-a921e59f-8102-4303-b860-3e35226c878e-delete_volume" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-a921e59f-8102-4303-b860-3e35226c878e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "cinder-quobyte-a921e59f-8102-4303-b860-3e35226c878e" by "delete_volume" {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-a921e59f-8102-4303-b860-3e35226c878e" acquired by "delete_volume" :: waited 0.012s {{(pid=87418) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d04de2-4ae3-4ee9-bc09-e6388b1558d4]: (4, 'qcow2') {{(pid=89248) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:30 devstack sudo[108960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e
Sep 30 18:12:30 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:30 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e" returned: 0 in 0.350s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:30 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:30 devstack sudo[108965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e
Sep 30 18:12:30 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:31 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3/volume-a921e59f-8102-4303-b860-3e35226c878e" returned: 0 in 0.239s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-quobyte-a921e59f-8102-4303-b860-3e35226c878e" released by "delete_volume" :: held 0.649s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG cinder.quota [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Created reservations ['ef7e29e3-7d15-407f-af61-3459b8568302', 'bd243d33-f31c-4795-8b6c-5e6e7d1dd7a4', '269eab13-5949-4370-80c2-6383b3792e6f', '57e3e222-cca1-456c-aa6d-5a90820ac335'] {{(pid=87418) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:31 devstack sudo[108968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:12:31 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:31 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.232s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:12:31 devstack cinder-volume[87418]: INFO cinder.volume.manager [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Deleted volume successfully.
Sep 30 18:12:31 devstack cinder-volume[87418]: DEBUG cinder.coordination [None req-dfc64393-7d24-4c27-aee0-8ac267f2b251 tempest-ProjectMemberTests-2136822435 None] Lock "cinder-a921e59f-8102-4303-b860-3e35226c878e-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87418) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f': None} {{(pid=87418) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e6346e5-6553-4e1c-a515-d17f9320929f'] {{(pid=87418) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.lockutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87418) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3 {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 30 18:12:46 devstack sudo[108985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3
Sep 30 18:12:46 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 18:12:46 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_concurrency.processutils [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b57da669f23abe7e900adfa9f46588e3" returned: 0 in 0.239s {{(pid=87418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG cinder.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Notifying Schedulers of capabilities ... {{(pid=87418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG oslo_service.periodic_task [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread count: 28 {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 30 18:12:46 devstack cinder-volume[87418]: DEBUG cinder.volume.manager [None req-ca3ba571-e424-4ad0-9d2a-7123c8f3b6aa None None] thread info: [<_MainThread(MainThread, started 127274120818816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127274006928896)>, <Thread(Thread-3 (stat_writer), started daemon 127274005919744)>, <Thread(Rabbit-heartbeat, started daemon 127274008832576)>, <Thread(Thread-5 (_runner), started daemon 127274004700736)>, <Thread(Thread-7 (_runner), started daemon 127274004827392)>, <Thread(fd_logger, started daemon 127274000845952)>, <Thread(privsep_reader, started daemon 127274005064064)>, <Thread(tpool_thread_0, started daemon 127273997072064)>, <Thread(tpool_thread_1, started daemon 127273988679360)>, <Thread(tpool_thread_2, started daemon 127273980270272)>, <Thread(tpool_thread_3, started daemon 127273971861184)>, <Thread(tpool_thread_4, started daemon 127273963452096)>, <Thread(tpool_thread_5, started daemon 127273955043008)>, <Thread(tpool_thread_6, started daemon 127273946633920)>, <Thread(tpool_thread_7, started daemon 127273938224832)>, <Thread(tpool_thread_8, started daemon 127273929815744)>, <Thread(tpool_thread_9, started daemon 127273921406656)>, <Thread(tpool_thread_10, started daemon 127273912997568)>, <Thread(tpool_thread_11, started daemon 127273904588480)>, <Thread(tpool_thread_12, started daemon 127273896179392)>, <Thread(tpool_thread_13, started daemon 127273887770304)>, <Thread(tpool_thread_14, started daemon 127273879361216)>, <Thread(tpool_thread_15, started daemon 127273870952128)>, <Thread(tpool_thread_16, started daemon 127273862543040)>, <Thread(tpool_thread_17, started daemon 127273854133952)>, <Thread(tpool_thread_18, started daemon 127273845724864)>, <Thread(tpool_thread_19, started daemon 127273837315776)>] {{(pid=87418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 30 18:12:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:SELECT=101,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=7 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 30 18:12:49 devstack cinder-volume[87418]: DEBUG dbcounter [-] [87418] Writing DB stats cinder:UPDATE=119,cinder:SELECT=84,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}